2023-02-13 04:53:33,642 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-13 04:53:33,927 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533 2023-02-13 04:53:33,941 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-13 04:53:33,942 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/cluster_98a6d5ea-75e8-c972-88d1-3a74142f0e58, deleteOnExit=true 2023-02-13 04:53:33,942 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 04:53:33,943 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/test.cache.data in system properties and HBase conf 2023-02-13 04:53:33,943 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 04:53:33,943 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/hadoop.log.dir in system properties and HBase conf 2023-02-13 04:53:33,944 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 04:53:33,944 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 04:53:33,944 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 04:53:34,061 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 04:53:34,492 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 04:53:34,497 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:53:34,497 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:53:34,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 04:53:34,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:53:34,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 04:53:34,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 04:53:34,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:53:34,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:53:34,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 04:53:34,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/nfs.dump.dir in system properties and HBase conf 2023-02-13 04:53:34,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/java.io.tmpdir in system properties and HBase conf 2023-02-13 04:53:34,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:53:34,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 04:53:34,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 04:53:35,128 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:53:35,133 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:53:35,413 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 04:53:35,594 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 04:53:35,611 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:53:35,649 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:53:35,683 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/java.io.tmpdir/Jetty_localhost_34365_hdfs____cx9e57/webapp 2023-02-13 04:53:35,829 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34365 2023-02-13 04:53:35,869 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:53:35,869 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:53:36,340 WARN [Listener at localhost/42827] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:53:36,457 WARN [Listener at localhost/42827] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:53:36,477 WARN [Listener at localhost/42827] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:53:36,484 INFO [Listener at localhost/42827] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:53:36,488 INFO [Listener at localhost/42827] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/java.io.tmpdir/Jetty_localhost_43337_datanode____3k1gin/webapp 2023-02-13 04:53:36,589 INFO [Listener at localhost/42827] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43337 2023-02-13 04:53:36,953 WARN [Listener at localhost/37751] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:53:37,517 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf1c6946ea520b32d: Processing first storage report for DS-752f541e-c2ce-4824-9fa2-b67dd8a1f60d from datanode d8b42276-0f0c-4620-8eae-4cb8d42ffb66 2023-02-13 04:53:37,519 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf1c6946ea520b32d: from storage DS-752f541e-c2ce-4824-9fa2-b67dd8a1f60d node DatanodeRegistration(127.0.0.1:42739, datanodeUuid=d8b42276-0f0c-4620-8eae-4cb8d42ffb66, infoPort=46023, infoSecurePort=0, ipcPort=37751, storageInfo=lv=-57;cid=testClusterID;nsid=994939357;c=1676264015206), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-13 04:53:37,520 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf1c6946ea520b32d: Processing first storage report for DS-52f7afbb-d2ca-44a4-aef8-97a7a8c63753 from datanode d8b42276-0f0c-4620-8eae-4cb8d42ffb66 2023-02-13 04:53:37,520 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf1c6946ea520b32d: from storage DS-52f7afbb-d2ca-44a4-aef8-97a7a8c63753 node DatanodeRegistration(127.0.0.1:42739, datanodeUuid=d8b42276-0f0c-4620-8eae-4cb8d42ffb66, infoPort=46023, infoSecurePort=0, ipcPort=37751, storageInfo=lv=-57;cid=testClusterID;nsid=994939357;c=1676264015206), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:53:37,585 DEBUG [Listener at localhost/37751] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533 2023-02-13 04:53:37,651 INFO [Listener at localhost/37751] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/cluster_98a6d5ea-75e8-c972-88d1-3a74142f0e58/zookeeper_0, clientPort=54862, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/cluster_98a6d5ea-75e8-c972-88d1-3a74142f0e58/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/cluster_98a6d5ea-75e8-c972-88d1-3a74142f0e58/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 04:53:37,667 INFO [Listener at localhost/37751] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54862 2023-02-13 04:53:37,677 INFO [Listener at localhost/37751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:53:37,679 INFO [Listener at localhost/37751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:53:38,342 INFO [Listener at localhost/37751] util.FSUtils(479): Created version file at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553 with version=8 2023-02-13 04:53:38,342 INFO [Listener at localhost/37751] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/hbase-staging 2023-02-13 04:53:38,654 INFO [Listener at localhost/37751] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 04:53:39,103 INFO [Listener at localhost/37751] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-02-13 04:53:39,133 INFO [Listener at localhost/37751] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:53:39,134 INFO [Listener at localhost/37751] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:53:39,134 INFO [Listener at localhost/37751] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:53:39,134 INFO [Listener at localhost/37751] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:53:39,134 INFO [Listener at localhost/37751] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:53:39,282 INFO [Listener at localhost/37751] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:53:39,362 DEBUG [Listener at localhost/37751] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 04:53:39,455 INFO [Listener at localhost/37751] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36431 2023-02-13 04:53:39,466 INFO [Listener at localhost/37751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:53:39,468 INFO [Listener at localhost/37751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:53:39,489 INFO [Listener at localhost/37751] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36431 connecting to ZooKeeper ensemble=127.0.0.1:54862 2023-02-13 04:53:39,528 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:364310x0, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:53:39,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36431-0x1004c06f8aa0000 connected 2023-02-13 04:53:39,567 DEBUG [Listener at localhost/37751] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:53:39,567 DEBUG [Listener at localhost/37751] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:53:39,572 DEBUG [Listener at localhost/37751] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:53:39,580 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36431 2023-02-13 04:53:39,584 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36431 2023-02-13 04:53:39,584 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36431 2023-02-13 04:53:39,585 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36431 2023-02-13 04:53:39,585 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36431 2023-02-13 04:53:39,591 INFO [Listener at localhost/37751] master.HMaster(439): hbase.rootdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553, hbase.cluster.distributed=false 2023-02-13 04:53:39,660 INFO [Listener at localhost/37751] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-02-13 04:53:39,661 INFO [Listener at localhost/37751] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:53:39,661 INFO [Listener at localhost/37751] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:53:39,661 INFO [Listener at localhost/37751] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:53:39,661 INFO [Listener at localhost/37751] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:53:39,661 INFO [Listener at localhost/37751] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:53:39,666 INFO [Listener at localhost/37751] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:53:39,669 INFO [Listener at localhost/37751] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37513 2023-02-13 04:53:39,671 INFO [Listener at localhost/37751] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:53:39,677 DEBUG [Listener at localhost/37751] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:53:39,678 INFO [Listener at localhost/37751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:53:39,680 INFO [Listener at localhost/37751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:53:39,682 INFO [Listener at localhost/37751] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37513 connecting to ZooKeeper ensemble=127.0.0.1:54862 2023-02-13 04:53:39,685 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:375130x0, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:53:39,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37513-0x1004c06f8aa0001 connected 2023-02-13 04:53:39,686 DEBUG [Listener at localhost/37751] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:53:39,688 DEBUG [Listener at localhost/37751] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:53:39,689 DEBUG [Listener at localhost/37751] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:53:39,689 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37513 2023-02-13 04:53:39,689 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37513 2023-02-13 04:53:39,692 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37513 2023-02-13 04:53:39,694 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37513 2023-02-13 04:53:39,695 DEBUG [Listener at localhost/37751] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37513 2023-02-13 04:53:39,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:53:39,708 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:53:39,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:53:39,736 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:53:39,736 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:53:39,736 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:53:39,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:53:39,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36431,1676264018484 from backup master directory 2023-02-13 04:53:39,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:53:39,741 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:53:39,741 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:53:39,742 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:53:39,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:53:39,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 04:53:39,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 04:53:39,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/hbase.id with ID: bf2f5a1a-83db-44f7-ac2f-03e5e9934a63 2023-02-13 04:53:39,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:53:39,886 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:53:39,925 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x08b7ac94 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:53:39,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4228c8f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:53:39,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:53:39,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 04:53:40,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 04:53:40,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 04:53:40,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 04:53:40,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 04:53:40,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:53:40,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/data/master/store-tmp 2023-02-13 04:53:40,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:40,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:53:40,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:53:40,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:53:40,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:53:40,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:53:40,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:53:40,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676264020482Disabling compacts and flushes for region at 1676264020483 (+1 ms)Disabling writes for close at 1676264020484 (+1 ms)Writing region close event to WAL at 1676264020484Closed at 1676264020484 2023-02-13 04:53:40,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/WALs/jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:53:40,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36431%2C1676264018484, suffix=, logDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/WALs/jenkins-hbase4.apache.org,36431,1676264018484, archiveDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/oldWALs, maxLogs=10 2023-02-13 04:53:40,574 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42739,DS-752f541e-c2ce-4824-9fa2-b67dd8a1f60d,DISK] 2023-02-13 04:53:40,583 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 04:53:40,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/WALs/jenkins-hbase4.apache.org,36431,1676264018484/jenkins-hbase4.apache.org%2C36431%2C1676264018484.1676264020520 2023-02-13 04:53:40,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42739,DS-752f541e-c2ce-4824-9fa2-b67dd8a1f60d,DISK]] 2023-02-13 04:53:40,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:53:40,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:40,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:53:40,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:53:40,748 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:53:40,756 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 04:53:40,786 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 04:53:40,799 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:40,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:53:40,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:53:40,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:53:40,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:53:40,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73304402, jitterRate=0.09232071042060852}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:53:40,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676264020706Initializing all the Stores at 1676264020708 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676264020709 (+1 ms)Cleaning up temporary data from old regions at 1676264020814 (+105 ms)Cleaning up detritus from prior splits at 1676264020815 (+1 ms)Region opened successfully at 1676264020829 (+14 ms) 2023-02-13 04:53:40,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 04:53:40,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 04:53:40,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 04:53:40,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 04:53:40,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 04:53:40,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-02-13 04:53:40,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 04:53:40,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 04:53:40,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 04:53:40,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 04:53:40,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 04:53:40,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 04:53:40,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 04:53:40,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 04:53:40,975 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:53:40,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 04:53:40,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 04:53:40,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 04:53:40,995 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:53:40,995 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:53:40,996 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:53:40,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36431,1676264018484, sessionid=0x1004c06f8aa0000, setting cluster-up flag (Was=false) 2023-02-13 04:53:41,015 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:53:41,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 04:53:41,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:53:41,028 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:53:41,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 04:53:41,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:53:41,038 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/.tmp 2023-02-13 04:53:41,118 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(952): ClusterId : bf2f5a1a-83db-44f7-ac2f-03e5e9934a63 2023-02-13 04:53:41,135 DEBUG [RS:0;jenkins-hbase4:37513] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:53:41,154 DEBUG [RS:0;jenkins-hbase4:37513] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:53:41,154 DEBUG [RS:0;jenkins-hbase4:37513] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:53:41,161 DEBUG [RS:0;jenkins-hbase4:37513] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:53:41,162 DEBUG [RS:0;jenkins-hbase4:37513] zookeeper.ReadOnlyZKClient(139): Connect 0x68922268 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:53:41,169 DEBUG [RS:0;jenkins-hbase4:37513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6655d10a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:53:41,170 DEBUG [RS:0;jenkins-hbase4:37513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@626a4918, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:53:41,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 04:53:41,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:53:41,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:53:41,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:53:41,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:53:41,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 04:53:41,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:53:41,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676264051201 2023-02-13 04:53:41,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 04:53:41,206 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:53:41,206 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 04:53:41,209 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37513 2023-02-13 04:53:41,213 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:53:41,214 INFO [RS:0;jenkins-hbase4:37513] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:53:41,214 INFO [RS:0;jenkins-hbase4:37513] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:53:41,214 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:53:41,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 04:53:41,217 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36431,1676264018484 with isa=jenkins-hbase4.apache.org/172.31.14.131:37513, startcode=1676264019660 2023-02-13 04:53:41,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 04:53:41,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 04:53:41,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 04:53:41,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 04:53:41,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 04:53:41,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 04:53:41,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 04:53:41,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 04:53:41,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 04:53:41,238 DEBUG [RS:0;jenkins-hbase4:37513] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:53:41,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676264021238,5,FailOnTimeoutGroup] 2023-02-13 04:53:41,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676264021240,5,FailOnTimeoutGroup] 2023-02-13 04:53:41,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 04:53:41,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,297 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37533, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:53:41,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:41,329 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553 2023-02-13 04:53:41,329 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42827 2023-02-13 04:53:41,329 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:53:41,335 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:53:41,337 DEBUG [RS:0;jenkins-hbase4:37513] zookeeper.ZKUtil(162): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:41,337 WARN [RS:0;jenkins-hbase4:37513] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:53:41,338 INFO [RS:0;jenkins-hbase4:37513] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:53:41,338 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/WALs/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:41,341 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37513,1676264019660] 2023-02-13 04:53:41,358 DEBUG [RS:0;jenkins-hbase4:37513] zookeeper.ZKUtil(162): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:41,372 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:53:41,384 INFO [RS:0;jenkins-hbase4:37513] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:53:41,408 INFO [RS:0;jenkins-hbase4:37513] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:53:41,416 INFO [RS:0;jenkins-hbase4:37513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:53:41,417 INFO [RS:0;jenkins-hbase4:37513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,418 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:53:41,426 INFO [RS:0;jenkins-hbase4:37513] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,426 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,427 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,427 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,427 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,427 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,428 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:53:41,428 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,428 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,428 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,428 DEBUG [RS:0;jenkins-hbase4:37513] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:53:41,431 INFO [RS:0;jenkins-hbase4:37513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,431 INFO [RS:0;jenkins-hbase4:37513] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,431 INFO [RS:0;jenkins-hbase4:37513] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,450 INFO [RS:0;jenkins-hbase4:37513] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:53:41,453 INFO [RS:0;jenkins-hbase4:37513] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37513,1676264019660-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:41,478 INFO [RS:0;jenkins-hbase4:37513] regionserver.Replication(203): jenkins-hbase4.apache.org,37513,1676264019660 started 2023-02-13 04:53:41,478 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37513,1676264019660, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37513, sessionid=0x1004c06f8aa0001 2023-02-13 04:53:41,478 DEBUG [RS:0;jenkins-hbase4:37513] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:53:41,478 DEBUG [RS:0;jenkins-hbase4:37513] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:41,478 DEBUG [RS:0;jenkins-hbase4:37513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37513,1676264019660' 2023-02-13 04:53:41,478 DEBUG [RS:0;jenkins-hbase4:37513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:41,479 DEBUG [RS:0;jenkins-hbase4:37513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:41,480 DEBUG [RS:0;jenkins-hbase4:37513] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:53:41,480 DEBUG [RS:0;jenkins-hbase4:37513] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:53:41,480 DEBUG [RS:0;jenkins-hbase4:37513] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:41,480 DEBUG [RS:0;jenkins-hbase4:37513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37513,1676264019660' 2023-02-13 04:53:41,480 DEBUG [RS:0;jenkins-hbase4:37513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:53:41,481 DEBUG [RS:0;jenkins-hbase4:37513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:53:41,481 DEBUG [RS:0;jenkins-hbase4:37513] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:53:41,481 INFO [RS:0;jenkins-hbase4:37513] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:53:41,481 INFO [RS:0;jenkins-hbase4:37513] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:53:41,596 INFO [RS:0;jenkins-hbase4:37513] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37513%2C1676264019660, suffix=, logDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/WALs/jenkins-hbase4.apache.org,37513,1676264019660, archiveDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/oldWALs, maxLogs=32 2023-02-13 04:53:41,622 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42739,DS-752f541e-c2ce-4824-9fa2-b67dd8a1f60d,DISK] 2023-02-13 04:53:41,626 INFO [RS:0;jenkins-hbase4:37513] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/WALs/jenkins-hbase4.apache.org,37513,1676264019660/jenkins-hbase4.apache.org%2C37513%2C1676264019660.1676264021600 2023-02-13 04:53:41,627 DEBUG [RS:0;jenkins-hbase4:37513] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42739,DS-752f541e-c2ce-4824-9fa2-b67dd8a1f60d,DISK]] 2023-02-13 04:53:41,662 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:53:41,663 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:53:41,663 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553 2023-02-13 04:53:42,079 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:42,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:53:42,085 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/info 2023-02-13 04:53:42,086 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:53:42,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:42,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:53:42,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:53:42,091 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:53:42,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:42,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:53:42,094 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/table 2023-02-13 04:53:42,095 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:53:42,096 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:42,097 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740 2023-02-13 04:53:42,098 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740 2023-02-13 04:53:42,102 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:53:42,104 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:53:42,108 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:53:42,109 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74507790, jitterRate=0.11025258898735046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:53:42,109 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676264022079Initializing all the Stores at 1676264022081 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676264022081Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676264022081Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676264022081Cleaning up temporary data from old regions at 1676264022100 (+19 ms)Cleaning up detritus from prior splits at 1676264022100Region opened successfully at 1676264022109 (+9 ms) 2023-02-13 04:53:42,109 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:53:42,109 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:53:42,109 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:53:42,109 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:53:42,109 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:53:42,110 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:53:42,111 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676264022109Disabling compacts and flushes for region at 1676264022109Disabling writes for close at 1676264022109Writing region close event to WAL at 1676264022110 (+1 ms)Closed at 1676264022110 2023-02-13 04:53:42,116 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:53:42,116 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 04:53:42,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 04:53:42,136 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 04:53:42,139 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 04:53:42,291 DEBUG [jenkins-hbase4:36431] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-13 04:53:42,294 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37513,1676264019660, state=OPENING 2023-02-13 04:53:42,301 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 04:53:42,303 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:53:42,303 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:53:42,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:53:42,489 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:42,491 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:53:42,494 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57990, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:53:42,505 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 04:53:42,505 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:53:42,508 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37513%2C1676264019660.meta, suffix=.meta, logDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/WALs/jenkins-hbase4.apache.org,37513,1676264019660, archiveDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/oldWALs, maxLogs=32 2023-02-13 04:53:42,528 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42739,DS-752f541e-c2ce-4824-9fa2-b67dd8a1f60d,DISK] 2023-02-13 04:53:42,532 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/WALs/jenkins-hbase4.apache.org,37513,1676264019660/jenkins-hbase4.apache.org%2C37513%2C1676264019660.meta.1676264022510.meta 2023-02-13 04:53:42,533 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42739,DS-752f541e-c2ce-4824-9fa2-b67dd8a1f60d,DISK]] 2023-02-13 04:53:42,533 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:53:42,535 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 04:53:42,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 04:53:42,556 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 04:53:42,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 04:53:42,561 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:42,562 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 04:53:42,562 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 04:53:42,564 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:53:42,566 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/info 2023-02-13 04:53:42,566 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/info 2023-02-13 04:53:42,567 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:53:42,567 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:42,568 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:53:42,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:53:42,569 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:53:42,570 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:53:42,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:42,571 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:53:42,572 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/table 2023-02-13 04:53:42,572 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/table 2023-02-13 04:53:42,573 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:53:42,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:42,576 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740 2023-02-13 04:53:42,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740 2023-02-13 04:53:42,584 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:53:42,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:53:42,588 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66114510, jitterRate=-0.014817029237747192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:53:42,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676264022562Writing region info on filesystem at 1676264022562Initializing all the Stores at 1676264022564 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676264022564Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676264022564Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676264022564Cleaning up temporary data from old regions at 1676264022581 (+17 ms)Cleaning up detritus from prior splits at 1676264022582 (+1 ms)Running coprocessor post-open hooks at 1676264022588 (+6 ms)Region opened successfully at 1676264022589 (+1 ms) 2023-02-13 04:53:42,598 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676264022481 2023-02-13 04:53:42,617 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 04:53:42,618 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 04:53:42,618 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37513,1676264019660, state=OPEN 2023-02-13 04:53:42,622 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 04:53:42,623 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:53:42,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 04:53:42,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37513,1676264019660 in 318 msec 2023-02-13 04:53:42,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 04:53:42,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 505 msec 2023-02-13 04:53:42,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5520 sec 2023-02-13 04:53:42,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676264019730, completionTime=-1 2023-02-13 04:53:42,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-13 04:53:42,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 04:53:42,701 DEBUG [hconnection-0x10a9aa8e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:53:42,705 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:53:42,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-13 04:53:42,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676264082722 2023-02-13 04:53:42,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676264142722 2023-02-13 04:53:42,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 81 msec 2023-02-13 04:53:42,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36431,1676264018484-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:42,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36431,1676264018484-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:42,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36431,1676264018484-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:42,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36431, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:42,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 04:53:42,760 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 04:53:42,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 04:53:42,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:53:42,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 04:53:42,780 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:53:42,783 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:53:42,806 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/hbase/namespace/33ece068d353171a34dc973e93f1580e 2023-02-13 04:53:42,808 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/hbase/namespace/33ece068d353171a34dc973e93f1580e empty. 2023-02-13 04:53:42,809 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/hbase/namespace/33ece068d353171a34dc973e93f1580e 2023-02-13 04:53:42,809 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 04:53:42,839 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 04:53:42,841 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 33ece068d353171a34dc973e93f1580e, NAME => 'hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:53:42,852 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:42,852 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 33ece068d353171a34dc973e93f1580e, disabling compactions & flushes 2023-02-13 04:53:42,852 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:53:42,852 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:53:42,852 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. after waiting 0 ms 2023-02-13 04:53:42,852 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:53:42,852 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:53:42,852 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 33ece068d353171a34dc973e93f1580e: Waiting for close lock at 1676264022852Disabling compacts and flushes for region at 1676264022852Disabling writes for close at 1676264022852Writing region close event to WAL at 1676264022852Closed at 1676264022852 2023-02-13 04:53:42,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:53:42,871 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676264022859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264022859"}]},"ts":"1676264022859"} 2023-02-13 04:53:42,901 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:53:42,903 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:53:42,908 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264022903"}]},"ts":"1676264022903"} 2023-02-13 04:53:42,912 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 04:53:42,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=33ece068d353171a34dc973e93f1580e, ASSIGN}] 2023-02-13 04:53:42,926 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=33ece068d353171a34dc973e93f1580e, ASSIGN 2023-02-13 04:53:42,927 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=33ece068d353171a34dc973e93f1580e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:53:43,079 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=33ece068d353171a34dc973e93f1580e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:43,079 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676264023078"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264023078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264023078"}]},"ts":"1676264023078"} 2023-02-13 04:53:43,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 33ece068d353171a34dc973e93f1580e, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:53:43,243 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:53:43,244 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 33ece068d353171a34dc973e93f1580e, NAME => 'hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:53:43,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 33ece068d353171a34dc973e93f1580e 2023-02-13 04:53:43,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:43,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 33ece068d353171a34dc973e93f1580e 2023-02-13 04:53:43,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 33ece068d353171a34dc973e93f1580e 2023-02-13 04:53:43,247 INFO [StoreOpener-33ece068d353171a34dc973e93f1580e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 33ece068d353171a34dc973e93f1580e 2023-02-13 04:53:43,250 DEBUG [StoreOpener-33ece068d353171a34dc973e93f1580e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e/info 2023-02-13 04:53:43,250 DEBUG [StoreOpener-33ece068d353171a34dc973e93f1580e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e/info 2023-02-13 04:53:43,250 INFO [StoreOpener-33ece068d353171a34dc973e93f1580e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33ece068d353171a34dc973e93f1580e columnFamilyName info 2023-02-13 04:53:43,251 INFO [StoreOpener-33ece068d353171a34dc973e93f1580e-1] regionserver.HStore(310): Store=33ece068d353171a34dc973e93f1580e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:43,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e 2023-02-13 04:53:43,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e 2023-02-13 04:53:43,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 33ece068d353171a34dc973e93f1580e 2023-02-13 04:53:43,262 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:53:43,262 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 33ece068d353171a34dc973e93f1580e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70647206, jitterRate=0.052725404500961304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:53:43,263 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 33ece068d353171a34dc973e93f1580e: Running coprocessor pre-open hook at 1676264023245Writing region info on filesystem at 1676264023245Initializing all the Stores at 1676264023247 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676264023247Cleaning up temporary data from old regions at 1676264023254 (+7 ms)Cleaning up detritus from prior splits at 1676264023255 (+1 ms)Running coprocessor post-open hooks at 1676264023263 (+8 ms)Region opened successfully at 1676264023263 2023-02-13 04:53:43,265 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e., pid=6, masterSystemTime=1676264023237 2023-02-13 04:53:43,269 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:53:43,269 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:53:43,270 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=33ece068d353171a34dc973e93f1580e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:43,271 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676264023270"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264023270"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264023270"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264023270"}]},"ts":"1676264023270"} 2023-02-13 04:53:43,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 04:53:43,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 33ece068d353171a34dc973e93f1580e, server=jenkins-hbase4.apache.org,37513,1676264019660 in 192 msec 2023-02-13 04:53:43,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 04:53:43,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=33ece068d353171a34dc973e93f1580e, ASSIGN in 356 msec 2023-02-13 04:53:43,284 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:53:43,285 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264023285"}]},"ts":"1676264023285"} 2023-02-13 04:53:43,287 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 04:53:43,291 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:53:43,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 523 msec 2023-02-13 04:53:43,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 04:53:43,381 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:53:43,381 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:53:43,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 04:53:43,439 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:53:43,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-02-13 04:53:43,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 04:53:43,467 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:53:43,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-02-13 04:53:43,483 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 04:53:43,485 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 04:53:43,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.743sec 2023-02-13 04:53:43,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 04:53:43,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 04:53:43,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 04:53:43,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36431,1676264018484-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 04:53:43,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36431,1676264018484-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 04:53:43,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 04:53:43,519 DEBUG [Listener at localhost/37751] zookeeper.ReadOnlyZKClient(139): Connect 0x515b7931 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:53:43,525 DEBUG [Listener at localhost/37751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e502965, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:53:43,537 DEBUG [hconnection-0x71e02888-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:53:43,548 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:53:43,558 INFO [Listener at localhost/37751] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:53:43,559 DEBUG [Listener at localhost/37751] zookeeper.ReadOnlyZKClient(139): Connect 0x4e2f2d5d to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:53:43,564 DEBUG [Listener at localhost/37751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41a72a4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:53:43,564 INFO [Listener at localhost/37751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:53:43,587 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=209, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=305, ProcessCount=168, AvailableMemoryMB=4305 2023-02-13 04:53:43,600 DEBUG [Listener at localhost/37751] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:53:43,604 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33524, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:53:43,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 04:53:43,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:43,626 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:53:43,629 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:53:43,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-13 04:53:43,632 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:43,634 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3 empty. 2023-02-13 04:53:43,636 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:43,636 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-13 04:53:43,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 04:53:43,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 04:53:43,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 04:53:44,057 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 04:53:44,060 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6d63ec892cabd8db21fc52a71cc505d3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:53:44,072 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:44,072 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 6d63ec892cabd8db21fc52a71cc505d3, disabling compactions & flushes 2023-02-13 04:53:44,072 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:44,072 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:44,072 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. after waiting 0 ms 2023-02-13 04:53:44,073 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:44,073 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:44,073 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 6d63ec892cabd8db21fc52a71cc505d3: Waiting for close lock at 1676264024072Disabling compacts and flushes for region at 1676264024072Disabling writes for close at 1676264024073 (+1 ms)Writing region close event to WAL at 1676264024073Closed at 1676264024073 2023-02-13 04:53:44,077 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:53:44,078 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676264024078"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264024078"}]},"ts":"1676264024078"} 2023-02-13 04:53:44,081 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:53:44,082 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:53:44,082 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264024082"}]},"ts":"1676264024082"} 2023-02-13 04:53:44,085 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-13 04:53:44,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6d63ec892cabd8db21fc52a71cc505d3, ASSIGN}] 2023-02-13 04:53:44,090 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6d63ec892cabd8db21fc52a71cc505d3, ASSIGN 2023-02-13 04:53:44,092 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6d63ec892cabd8db21fc52a71cc505d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:53:44,243 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d63ec892cabd8db21fc52a71cc505d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:44,244 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676264024243"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264024243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264024243"}]},"ts":"1676264024243"} 2023-02-13 04:53:44,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 6d63ec892cabd8db21fc52a71cc505d3, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:53:44,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 04:53:44,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:44,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6d63ec892cabd8db21fc52a71cc505d3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:53:44,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:44,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:44,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:44,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:44,412 INFO [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:44,414 DEBUG [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:44,414 DEBUG [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:44,417 INFO [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d63ec892cabd8db21fc52a71cc505d3 columnFamilyName family1 2023-02-13 04:53:44,420 INFO [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] regionserver.HStore(310): Store=6d63ec892cabd8db21fc52a71cc505d3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:44,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:44,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:44,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:44,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:53:44,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6d63ec892cabd8db21fc52a71cc505d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61315920, jitterRate=-0.08632159233093262}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:53:44,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6d63ec892cabd8db21fc52a71cc505d3: Running coprocessor pre-open hook at 1676264024409Writing region info on filesystem at 1676264024409Initializing all the Stores at 1676264024410 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676264024410Cleaning up temporary data from old regions at 1676264024425 (+15 ms)Cleaning up detritus from prior splits at 1676264024426 (+1 ms)Running coprocessor post-open hooks at 1676264024435 (+9 ms)Region opened successfully at 1676264024435 2023-02-13 04:53:44,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3., pid=11, masterSystemTime=1676264024402 2023-02-13 04:53:44,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:44,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:44,441 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=6d63ec892cabd8db21fc52a71cc505d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:44,441 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676264024440"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264024440"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264024440"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264024440"}]},"ts":"1676264024440"} 2023-02-13 04:53:44,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 04:53:44,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 6d63ec892cabd8db21fc52a71cc505d3, server=jenkins-hbase4.apache.org,37513,1676264019660 in 197 msec 2023-02-13 04:53:44,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-13 04:53:44,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6d63ec892cabd8db21fc52a71cc505d3, ASSIGN in 359 msec 2023-02-13 04:53:44,452 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:53:44,452 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264024452"}]},"ts":"1676264024452"} 2023-02-13 04:53:44,454 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-13 04:53:44,457 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:53:44,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 835 msec 2023-02-13 04:53:44,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 04:53:44,755 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-13 04:53:44,777 DEBUG [hconnection-0x6e1a1eeb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:53:44,780 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:53:44,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:44,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:44,955 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:44,955 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:44,956 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:44,956 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:44,957 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:44,957 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:44,958 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:44,958 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:44,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:44,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:44,959 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:44,959 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:44,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:44,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:44,961 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:44,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:44,963 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:44,963 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:44,964 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:44,964 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:44,965 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:44,965 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:44,966 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:44,967 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 04:53:45,515 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303a9bea37599644f1bf1564f986e44f3f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303a9bea37599644f1bf1564f986e44f3f 2023-02-13 04:53:45,930 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/f4b82ebd88bb4b7aafe61352bdc1d439 2023-02-13 04:53:45,941 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/f4b82ebd88bb4b7aafe61352bdc1d439 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/f4b82ebd88bb4b7aafe61352bdc1d439 2023-02-13 04:53:45,950 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/f4b82ebd88bb4b7aafe61352bdc1d439, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-13 04:53:45,953 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 987ms, sequenceid=5, compaction requested=false 2023-02-13 04:53:45,955 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:45,958 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:45,958 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:45,958 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:45,959 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:45,959 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,959 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:45,959 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:45,961 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,961 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:45,962 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,962 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:45,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:45,964 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:45,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40132c7f[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:45,964 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,966 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,967 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:45,967 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:45,967 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:45,967 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,967 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:45,969 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:45,969 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,969 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:45,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,969 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:45,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:45,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:45,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:45,974 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:45,974 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:45,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:45,974 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:45,974 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,974 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:45,976 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,976 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,976 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:45,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:45,977 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,979 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,986 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,986 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:45,986 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:45,986 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:45,986 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:45,986 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:45,987 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:45,987 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:45,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:45,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:45,987 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,987 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:45,989 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:45,989 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:46,089 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:46,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:46,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:46,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:46,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:46,137 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:46,137 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:46,138 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:46,138 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:46,138 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:46,138 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:46,144 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:46,144 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:46,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:46,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:46,145 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:46,145 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:46,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:46,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:46,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:46,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:46,146 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:46,146 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:46,146 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:46,146 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:46,146 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:46,147 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:46,147 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:46,147 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:46,147 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:46,147 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 04:53:46,573 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285bfd90ad52a945fdb4fcafc41f320d4b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285bfd90ad52a945fdb4fcafc41f320d4b 2023-02-13 04:53:46,985 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/a531b020bf6c414a82d475cce8e1d22f 2023-02-13 04:53:46,994 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/a531b020bf6c414a82d475cce8e1d22f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a531b020bf6c414a82d475cce8e1d22f 2023-02-13 04:53:47,002 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a531b020bf6c414a82d475cce8e1d22f, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 04:53:47,004 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 857ms, sequenceid=9, compaction requested=false 2023-02-13 04:53:47,004 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:47,004 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,005 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:47,005 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:47,007 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,007 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:47,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:47,007 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,007 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:47,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:47,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:47,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:47,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@399c080c[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:47,009 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:47,009 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,011 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,011 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:47,011 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:47,011 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:47,011 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,011 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:47,013 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,013 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:47,013 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:47,013 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:47,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:47,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:47,016 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:47,016 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:47,016 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:47,017 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,017 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:47,021 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,021 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:47,021 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:47,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:47,022 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:47,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,024 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:47,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,027 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,027 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:47,027 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:47,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 04:53:47,028 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:47,028 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:47,028 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:47,028 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:47,028 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,028 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,028 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:47,029 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:47,029 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:47,129 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:47,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:47,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:47,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:47,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,141 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:47,141 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:47,142 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:47,142 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:47,142 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,142 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,144 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,144 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:47,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:47,145 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,145 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,146 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,146 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 04:53:47,146 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,146 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:47,146 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:47,147 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:47,147 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:47,147 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:47,147 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:47,147 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:47,147 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:53:47,379 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 04:53:47,380 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 04:53:47,595 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e5a255eb89f048f68bec5aeef7985af0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e5a255eb89f048f68bec5aeef7985af0 2023-02-13 04:53:47,617 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/cd887c35e291413eab5b95fe66d9900b 2023-02-13 04:53:47,631 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/cd887c35e291413eab5b95fe66d9900b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd887c35e291413eab5b95fe66d9900b 2023-02-13 04:53:47,641 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd887c35e291413eab5b95fe66d9900b, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 04:53:47,642 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 495ms, sequenceid=13, compaction requested=true 2023-02-13 04:53:47,642 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:47,642 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:47,642 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:47,643 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:47,643 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,643 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:47,643 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:47,647 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,647 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:47,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:47,647 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,647 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:47,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:47,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:47,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:47,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:47,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66619bbb[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:47,651 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:47,651 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,653 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,653 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:47,653 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:47,653 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:47,653 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,654 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:47,656 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:47,656 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,656 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:47,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:47,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:47,656 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:47,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:47,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:47,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:47,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:47,664 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:47,664 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:47,664 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:47,664 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,664 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:47,667 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,667 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:47,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,667 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:47,668 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:47,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:47,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:47,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,673 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:47,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,684 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:47,684 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,684 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:47,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:47,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:47,684 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,684 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:47,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:47,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:47,684 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,685 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,685 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,685 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,685 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:47,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:47,686 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:47,686 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:47,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 04:53:47,786 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:47,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:47,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:47,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:47,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,800 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:47,800 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:47,800 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:47,801 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:47,801 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,801 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,804 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:47,804 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:47,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:47,804 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:47,804 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:47,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:47,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,806 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,807 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 04:53:47,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:47,807 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:47,807 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:47,808 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:47,808 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:47,808 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:47,808 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:47,808 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:47,808 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:53:47,840 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120597eceed848874838b8fb3a8e19ad47c8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120597eceed848874838b8fb3a8e19ad47c8 2023-02-13 04:53:48,092 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:53:48,256 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/3f9537b78c7d4475ba0f74933b35088e 2023-02-13 04:53:48,265 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/3f9537b78c7d4475ba0f74933b35088e as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/3f9537b78c7d4475ba0f74933b35088e 2023-02-13 04:53:48,275 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/3f9537b78c7d4475ba0f74933b35088e, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 04:53:48,276 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 468ms, sequenceid=17, compaction requested=true 2023-02-13 04:53:48,276 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:48,276 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:48,276 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:48,279 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,279 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:48,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:48,280 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,280 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:48,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:48,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:48,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:48,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:48,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cf7d42[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:48,282 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:48,282 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,283 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,283 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:48,283 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:48,283 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:48,284 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,284 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:48,286 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,286 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:48,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:48,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:48,286 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:48,286 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:48,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:48,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:48,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:48,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:48,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:48,290 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:48,290 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:48,290 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:48,290 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,290 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:48,292 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,292 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:48,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:48,292 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:48,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:48,293 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:48,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,295 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:48,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,300 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,300 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:48,301 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:48,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 04:53:48,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:48,301 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:48,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:48,301 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:48,301 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:48,301 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,302 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,302 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,302 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:48,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:48,302 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:48,302 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:48,402 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:48,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:48,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:48,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:48,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,414 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:48,414 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:48,414 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:48,414 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:48,415 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,415 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,416 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:48,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:48,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:48,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:48,417 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,418 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,418 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 04:53:48,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:48,419 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:48,419 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:48,419 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:48,419 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:48,419 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:53:48,648 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:53:48,649 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 04:53:48,841 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512289486775eb3b44d469f47097a4f308e66 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289486775eb3b44d469f47097a4f308e66 2023-02-13 04:53:49,253 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/9460375d0e4e4ce68c6855408c243a09 2023-02-13 04:53:49,262 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/9460375d0e4e4ce68c6855408c243a09 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/9460375d0e4e4ce68c6855408c243a09 2023-02-13 04:53:49,270 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/9460375d0e4e4ce68c6855408c243a09, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 04:53:49,272 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 853ms, sequenceid=21, compaction requested=true 2023-02-13 04:53:49,272 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:49,272 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:49,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:49,273 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:49,273 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,273 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:49,273 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:49,279 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,279 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:49,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:49,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:49,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:49,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:49,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d66d970[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:49,282 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:49,282 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,283 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:49,284 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,284 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:49,285 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:49,285 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,285 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:49,285 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:49,289 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:49,289 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:49,289 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:49,289 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,289 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:49,292 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,292 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:49,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,292 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:49,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:49,293 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,295 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,298 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,298 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:49,298 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:49,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:49,298 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:49,298 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:49,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:49,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:49,298 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:49,299 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:49,299 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,299 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,299 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,299 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:49,299 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:49,399 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:49,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:49,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:49,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:49,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,411 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:49,412 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:49,412 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:49,412 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:49,413 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,413 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,414 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,414 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:49,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:49,414 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,414 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:49,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:49,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,415 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,416 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 04:53:49,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,416 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:49,416 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:49,416 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:49,416 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:49,417 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:49,417 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:49,417 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:49,417 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:53:49,440 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a6ebd52e221c4bcbb1f6d05cdbb36077 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a6ebd52e221c4bcbb1f6d05cdbb36077 2023-02-13 04:53:49,851 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/a297c2975b754bb4bced36d12e434a27 2023-02-13 04:53:49,861 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/a297c2975b754bb4bced36d12e434a27 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a297c2975b754bb4bced36d12e434a27 2023-02-13 04:53:49,869 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a297c2975b754bb4bced36d12e434a27, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 04:53:49,871 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 454ms, sequenceid=25, compaction requested=true 2023-02-13 04:53:49,871 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:49,872 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:49,872 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:49,874 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,874 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:49,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:49,877 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,877 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:49,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:49,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:49,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:49,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46376b8[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:49,889 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:49,889 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,891 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,891 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:49,891 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:49,891 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:49,891 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,891 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:49,894 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:49,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:49,894 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:49,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:49,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:49,900 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:49,900 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:49,900 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:49,900 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,900 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:49,902 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,902 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:49,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,902 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:49,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:49,903 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,905 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:49,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,908 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:49,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:49,908 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:49,908 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,908 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,909 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,909 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:49,909 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,909 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,909 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:49,909 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:49,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:49,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:49,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:49,910 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:49,910 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:50,010 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:50,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:50,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:50,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:50,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,028 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:50,028 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:50,029 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:50,029 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:50,029 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,030 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,031 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,031 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:50,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:50,031 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,032 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:50,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,036 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 04:53:50,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:50,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:50,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:50,040 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:50,040 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:50,040 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:50,040 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:50,040 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:53:50,477 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010105fec396707c4d68abb2b33342747994 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010105fec396707c4d68abb2b33342747994 2023-02-13 04:53:50,891 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/c0857e95e8a941459398e0f52f8f7a29 2023-02-13 04:53:50,900 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/c0857e95e8a941459398e0f52f8f7a29 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/c0857e95e8a941459398e0f52f8f7a29 2023-02-13 04:53:50,910 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/c0857e95e8a941459398e0f52f8f7a29, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 04:53:50,911 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 871ms, sequenceid=29, compaction requested=true 2023-02-13 04:53:50,912 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:50,912 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:50,912 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:50,913 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:50,913 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,913 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:50,913 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:50,915 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,915 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:50,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:50,916 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:50,916 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:50,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:50,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:50,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:50,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e3589cc[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:50,919 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:50,919 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,920 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,921 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:50,921 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:50,921 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:50,921 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,921 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:50,922 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:50,922 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:50,922 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:50,923 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:50,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:50,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:50,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:50,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:50,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:50,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:50,927 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:50,927 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:50,927 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:50,927 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,927 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:50,929 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,929 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,929 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:50,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:50,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:50,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:50,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:50,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:50,931 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:50,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,934 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:50,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,943 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,943 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:50,943 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,943 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,943 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:50,943 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,944 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,944 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:50,944 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:50,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:50,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:50,943 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:50,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:50,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:50,945 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:50,945 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:50,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:50,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:51,045 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:51,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:51,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:51,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:51,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,057 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:51,058 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:51,058 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:51,058 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:51,059 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,059 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,061 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:51,061 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:51,062 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,062 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:51,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,063 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 04:53:51,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,064 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:51,064 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:51,064 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:51,064 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:51,064 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:51,064 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:51,065 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:51,065 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:53:51,487 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010316870c6d064d42328dd8eac02542e61f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010316870c6d064d42328dd8eac02542e61f 2023-02-13 04:53:51,500 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/ac4fa9c2409046769682a2345cd2caa2 2023-02-13 04:53:51,509 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/ac4fa9c2409046769682a2345cd2caa2 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac4fa9c2409046769682a2345cd2caa2 2023-02-13 04:53:51,518 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac4fa9c2409046769682a2345cd2caa2, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 04:53:51,519 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 454ms, sequenceid=33, compaction requested=true 2023-02-13 04:53:51,519 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:51,519 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:51,519 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:51,520 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:51,522 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,522 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:51,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:51,522 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,522 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:51,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:51,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:51,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:51,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:51,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@116fdc25[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:51,524 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:51,524 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,526 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,527 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:51,527 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:51,527 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:51,527 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,527 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:51,528 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,528 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:51,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:51,528 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:51,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:51,528 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:51,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:51,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:51,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:51,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:51,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:51,532 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:51,532 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:51,532 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:51,532 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,532 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:51,534 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:51,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:51,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:51,535 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:51,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,536 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:51,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,538 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,538 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:51,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:51,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 04:53:51,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:51,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:51,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:51,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:51,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 04:53:51,539 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:51,540 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:51,540 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:51,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:51,640 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:51,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:51,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:51,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:51,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,653 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:51,653 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:51,654 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:51,654 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:51,654 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,654 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,656 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:51,656 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:51,656 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:51,656 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,657 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,657 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 04:53:51,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:51,658 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:51,658 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:51,658 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:51,658 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:51,658 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:51,658 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:51,658 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:51,659 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:53:52,081 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090707f7e193cffb45008fe3f2b0ad1d9a1d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090707f7e193cffb45008fe3f2b0ad1d9a1d 2023-02-13 04:53:52,489 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/a85c6f2e4c3d4887be76c730fe771cb5 2023-02-13 04:53:52,497 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/a85c6f2e4c3d4887be76c730fe771cb5 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a85c6f2e4c3d4887be76c730fe771cb5 2023-02-13 04:53:52,504 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a85c6f2e4c3d4887be76c730fe771cb5, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 04:53:52,505 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 846ms, sequenceid=37, compaction requested=true 2023-02-13 04:53:52,505 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:52,505 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:52,506 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:52,506 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:52,506 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,506 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:52,506 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:52,508 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,508 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:52,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:52,508 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:52,509 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:52,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:52,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a293a21[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:52,510 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:52,510 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,511 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,512 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:52,512 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:52,512 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:52,512 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,512 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:52,513 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:52,513 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:52,513 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,513 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:52,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:52,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:52,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:52,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:52,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:52,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:52,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:52,517 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:52,517 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:52,518 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:52,518 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,518 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:52,520 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,520 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:52,520 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:52,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:52,521 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:52,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:52,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:52,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,522 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:52,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:52,525 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:52,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 04:53:52,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:52,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:52,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:52,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:52,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,526 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:52,526 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,526 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:52,526 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:52,626 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:52,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:52,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:52,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:52,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,637 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:52,637 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:52,638 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 04:53:52,638 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 04:53:52,638 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,638 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,640 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:52,640 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:52,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:52,640 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:52,640 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:52,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:52,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,641 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,642 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 04:53:52,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:52,642 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 04:53:52,642 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:52,643 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 04:53:52,643 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:52,643 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:52,643 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:52,643 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. started... 2023-02-13 04:53:52,643 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d63ec892cabd8db21fc52a71cc505d3 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:53:53,065 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b06844615f3c42258d3b00475f5da27a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b06844615f3c42258d3b00475f5da27a 2023-02-13 04:53:53,493 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/ac2a18742e1143b1808359617ace715f 2023-02-13 04:53:53,501 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/ac2a18742e1143b1808359617ace715f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac2a18742e1143b1808359617ace715f 2023-02-13 04:53:53,509 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac2a18742e1143b1808359617ace715f, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 04:53:53,510 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6d63ec892cabd8db21fc52a71cc505d3 in 867ms, sequenceid=41, compaction requested=true 2023-02-13 04:53:53,510 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:53,510 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:53,510 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:53,511 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:53,511 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,511 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 04:53:53,511 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 04:53:53,513 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,513 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:53,514 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,514 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:53,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 04:53:53,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65e0556a[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:53,516 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 04:53:53,516 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,517 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,517 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 04:53:53,517 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 04:53:53,517 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:53,518 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,518 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:53,522 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 04:53:53,522 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,522 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:53,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,522 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 04:53:53,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:53,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:53,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:53,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:53,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 04:53:53,533 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 04:53:53,533 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:53,533 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:53,534 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,534 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:53,536 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,536 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,536 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:53,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:53,538 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:53,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,539 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,542 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:53,542 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:53,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:53,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 04:53:53,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:53,542 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,542 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:53,543 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,543 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:53,543 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:53,543 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,543 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,543 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,543 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:53,543 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:53,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:53,643 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:53,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:53,650 DEBUG [Listener at localhost/37751] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:53:53,652 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36856, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:53:53,654 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:53,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 04:53:53,670 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 04:53:53,672 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264633672 2023-02-13 04:53:53,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:53:53,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:53:53,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 04:53:53,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:53,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x40b18af3 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:53:53,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46bd77fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:53:53,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:54,561 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038d53ce71b62d4368a6b7ae03accb2a40 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601038d53ce71b62d4368a6b7ae03accb2a40 2023-02-13 04:53:54,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:54,581 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:53:54,583 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56440, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:53:54,594 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:53:54,596 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36866, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:53:54,630 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/211e7e34272444588e7714b80d523658 first=Optional[r3] last=Optional[r6] 2023-02-13 04:53:54,643 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/211e7e34272444588e7714b80d523658}] 2023-02-13 04:53:54,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/211e7e34272444588e7714b80d523658 for inclusion in 6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:54,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 04:53:54,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:53:54,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:54,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/211e7e34272444588e7714b80d523658 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0p5jr0jbsa39f0bqs3d7cbnkf5oadnbf5ieqhuiih9ihlqgv97e8ti754ovgjr3/family1/211e7e34272444588e7714b80d523658 2023-02-13 04:53:54,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0p5jr0jbsa39f0bqs3d7cbnkf5oadnbf5ieqhuiih9ihlqgv97e8ti754ovgjr3/family1/211e7e34272444588e7714b80d523658 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd08284fa5ec4faba71c5ad2ca459e7e_SeqId_44_ 2023-02-13 04:53:54,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0p5jr0jbsa39f0bqs3d7cbnkf5oadnbf5ieqhuiih9ihlqgv97e8ti754ovgjr3/family1/211e7e34272444588e7714b80d523658 into 6d63ec892cabd8db21fc52a71cc505d3/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd08284fa5ec4faba71c5ad2ca459e7e_SeqId_44_ - updating store file list. 2023-02-13 04:53:54,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd08284fa5ec4faba71c5ad2ca459e7e_SeqId_44_ into 6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:54,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0p5jr0jbsa39f0bqs3d7cbnkf5oadnbf5ieqhuiih9ihlqgv97e8ti754ovgjr3/family1/211e7e34272444588e7714b80d523658 into 6d63ec892cabd8db21fc52a71cc505d3/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd08284fa5ec4faba71c5ad2ca459e7e_SeqId_44_) 2023-02-13 04:53:54,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__m0p5jr0jbsa39f0bqs3d7cbnkf5oadnbf5ieqhuiih9ihlqgv97e8ti754ovgjr3/family1/211e7e34272444588e7714b80d523658 2023-02-13 04:53:54,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 04:53:54,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 04:53:54,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(1912): 6d63ec892cabd8db21fc52a71cc505d3/family1 is initiating minor compaction 2023-02-13 04:53:54,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5161aaa8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:53:54,689 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 6d63ec892cabd8db21fc52a71cc505d3/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:54,690 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a531b020bf6c414a82d475cce8e1d22f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd887c35e291413eab5b95fe66d9900b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/3f9537b78c7d4475ba0f74933b35088e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/9460375d0e4e4ce68c6855408c243a09, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a297c2975b754bb4bced36d12e434a27, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/c0857e95e8a941459398e0f52f8f7a29, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac4fa9c2409046769682a2345cd2caa2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a85c6f2e4c3d4887be76c730fe771cb5, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac2a18742e1143b1808359617ace715f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd08284fa5ec4faba71c5ad2ca459e7e_SeqId_44_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp, totalSize=50.2 K 2023-02-13 04:53:54,690 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting a531b020bf6c414a82d475cce8e1d22f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 04:53:54,691 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting cd887c35e291413eab5b95fe66d9900b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 04:53:54,691 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 3f9537b78c7d4475ba0f74933b35088e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 04:53:54,691 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 9460375d0e4e4ce68c6855408c243a09, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 04:53:54,691 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting a297c2975b754bb4bced36d12e434a27, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 04:53:54,691 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting c0857e95e8a941459398e0f52f8f7a29, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 04:53:54,691 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting ac4fa9c2409046769682a2345cd2caa2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 04:53:54,691 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting a85c6f2e4c3d4887be76c730fe771cb5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 04:53:54,691 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting ac2a18742e1143b1808359617ace715f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 04:53:54,691 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting cd08284fa5ec4faba71c5ad2ca459e7e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 04:53:54,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:54,706 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:53:54,712 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289486775eb3b44d469f47097a4f308e66 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289486775eb3b44d469f47097a4f308e66 2023-02-13 04:53:54,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a6ebd52e221c4bcbb1f6d05cdbb36077 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a6ebd52e221c4bcbb1f6d05cdbb36077 2023-02-13 04:53:54,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010105fec396707c4d68abb2b33342747994 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010105fec396707c4d68abb2b33342747994 2023-02-13 04:53:54,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010316870c6d064d42328dd8eac02542e61f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010316870c6d064d42328dd8eac02542e61f 2023-02-13 04:53:54,717 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-13 04:53:54,717 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 04:53:54,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:54,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:54,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:54,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:54,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:54,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:54,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:54,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:54,751 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6d63ec892cabd8db21fc52a71cc505d3#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:53:55,577 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/2002ea433e7f4d2da2b09c9e5884fd4f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/2002ea433e7f4d2da2b09c9e5884fd4f 2023-02-13 04:53:55,595 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6d63ec892cabd8db21fc52a71cc505d3/family1 of 6d63ec892cabd8db21fc52a71cc505d3 into 2002ea433e7f4d2da2b09c9e5884fd4f(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:53:55,595 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:55,597 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676264034687; duration=0sec 2023-02-13 04:53:55,598 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:53:55,608 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120566bb914a8d2d40d9b75220fc743ca07a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120566bb914a8d2d40d9b75220fc743ca07a 2023-02-13 04:53:55,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:55,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a531b020bf6c414a82d475cce8e1d22f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd887c35e291413eab5b95fe66d9900b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/3f9537b78c7d4475ba0f74933b35088e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/9460375d0e4e4ce68c6855408c243a09, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a297c2975b754bb4bced36d12e434a27, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/c0857e95e8a941459398e0f52f8f7a29, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac4fa9c2409046769682a2345cd2caa2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a85c6f2e4c3d4887be76c730fe771cb5, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac2a18742e1143b1808359617ace715f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd08284fa5ec4faba71c5ad2ca459e7e_SeqId_44_] to archive 2023-02-13 04:53:55,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:53:55,648 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a531b020bf6c414a82d475cce8e1d22f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a531b020bf6c414a82d475cce8e1d22f 2023-02-13 04:53:55,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd887c35e291413eab5b95fe66d9900b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd887c35e291413eab5b95fe66d9900b 2023-02-13 04:53:55,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/3f9537b78c7d4475ba0f74933b35088e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/3f9537b78c7d4475ba0f74933b35088e 2023-02-13 04:53:55,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/9460375d0e4e4ce68c6855408c243a09 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/9460375d0e4e4ce68c6855408c243a09 2023-02-13 04:53:55,655 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7053c31467b249b2a836ef9cc7cf3d5b first=Optional[r00] last=Optional[r2] 2023-02-13 04:53:55,656 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7053c31467b249b2a836ef9cc7cf3d5b}] 2023-02-13 04:53:55,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a297c2975b754bb4bced36d12e434a27 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a297c2975b754bb4bced36d12e434a27 2023-02-13 04:53:55,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/c0857e95e8a941459398e0f52f8f7a29 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/c0857e95e8a941459398e0f52f8f7a29 2023-02-13 04:53:55,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7053c31467b249b2a836ef9cc7cf3d5b for inclusion in 6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:55,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac4fa9c2409046769682a2345cd2caa2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac4fa9c2409046769682a2345cd2caa2 2023-02-13 04:53:55,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a85c6f2e4c3d4887be76c730fe771cb5 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/a85c6f2e4c3d4887be76c730fe771cb5 2023-02-13 04:53:55,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 04:53:55,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:53:55,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:55,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac2a18742e1143b1808359617ace715f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/ac2a18742e1143b1808359617ace715f 2023-02-13 04:53:55,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7053c31467b249b2a836ef9cc7cf3d5b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8bsqug8ikkf46cikfjpekcn547b5dns1b224mt2kifhem3g3v4o0fveb6okp6e2/family1/7053c31467b249b2a836ef9cc7cf3d5b 2023-02-13 04:53:55,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd08284fa5ec4faba71c5ad2ca459e7e_SeqId_44_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/cd08284fa5ec4faba71c5ad2ca459e7e_SeqId_44_ 2023-02-13 04:53:55,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8bsqug8ikkf46cikfjpekcn547b5dns1b224mt2kifhem3g3v4o0fveb6okp6e2/family1/7053c31467b249b2a836ef9cc7cf3d5b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/e8a5330afcf64cd5b1b060b17708f3d7_SeqId_47_ 2023-02-13 04:53:55,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8bsqug8ikkf46cikfjpekcn547b5dns1b224mt2kifhem3g3v4o0fveb6okp6e2/family1/7053c31467b249b2a836ef9cc7cf3d5b into 6d63ec892cabd8db21fc52a71cc505d3/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/e8a5330afcf64cd5b1b060b17708f3d7_SeqId_47_ - updating store file list. 2023-02-13 04:53:55,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/e8a5330afcf64cd5b1b060b17708f3d7_SeqId_47_ into 6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:55,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8bsqug8ikkf46cikfjpekcn547b5dns1b224mt2kifhem3g3v4o0fveb6okp6e2/family1/7053c31467b249b2a836ef9cc7cf3d5b into 6d63ec892cabd8db21fc52a71cc505d3/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/e8a5330afcf64cd5b1b060b17708f3d7_SeqId_47_) 2023-02-13 04:53:55,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8bsqug8ikkf46cikfjpekcn547b5dns1b224mt2kifhem3g3v4o0fveb6okp6e2/family1/7053c31467b249b2a836ef9cc7cf3d5b 2023-02-13 04:53:55,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 04:53:55,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 04:53:55,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(1912): 6d63ec892cabd8db21fc52a71cc505d3/family1 is initiating minor compaction (all files) 2023-02-13 04:53:55,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@13cf6e6c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:53:55,687 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 6d63ec892cabd8db21fc52a71cc505d3/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:55,688 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/f4b82ebd88bb4b7aafe61352bdc1d439, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/2002ea433e7f4d2da2b09c9e5884fd4f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/e8a5330afcf64cd5b1b060b17708f3d7_SeqId_47_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp, totalSize=358.6 K 2023-02-13 04:53:55,688 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting f4b82ebd88bb4b7aafe61352bdc1d439, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843565 2023-02-13 04:53:55,689 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 2002ea433e7f4d2da2b09c9e5884fd4f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243565 2023-02-13 04:53:55,690 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting e8a5330afcf64cd5b1b060b17708f3d7_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878843565 2023-02-13 04:53:55,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:55,693 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:53:55,696 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303a9bea37599644f1bf1564f986e44f3f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303a9bea37599644f1bf1564f986e44f3f 2023-02-13 04:53:55,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e5a255eb89f048f68bec5aeef7985af0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e5a255eb89f048f68bec5aeef7985af0 2023-02-13 04:53:55,700 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120597eceed848874838b8fb3a8e19ad47c8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120597eceed848874838b8fb3a8e19ad47c8 2023-02-13 04:53:55,700 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-13 04:53:55,700 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 04:53:55,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:55,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:55,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:53:55,703 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 04:53:55,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0440 sec 2023-02-13 04:53:55,729 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6d63ec892cabd8db21fc52a71cc505d3#family1#compaction#11 average throughput is 6.88 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:53:55,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 04:53:55,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:55,873 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 04:53:55,874 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 04:53:55,874 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 04:53:55,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-13 04:53:55,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6d63ec892cabd8db21fc52a71cc505d3, REOPEN/MOVE}] 2023-02-13 04:53:55,893 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6d63ec892cabd8db21fc52a71cc505d3, REOPEN/MOVE 2023-02-13 04:53:55,894 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6d63ec892cabd8db21fc52a71cc505d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:55,894 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676264035894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264035894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264035894"}]},"ts":"1676264035894"} 2023-02-13 04:53:55,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 6d63ec892cabd8db21fc52a71cc505d3, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:53:56,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:56,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6d63ec892cabd8db21fc52a71cc505d3, disabling compactions & flushes 2023-02-13 04:53:56,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:56,565 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/.tmp/family1/da65a38db7464eb2813ebd1c2733e827 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/da65a38db7464eb2813ebd1c2733e827 2023-02-13 04:53:56,572 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6d63ec892cabd8db21fc52a71cc505d3/family1 of 6d63ec892cabd8db21fc52a71cc505d3 into da65a38db7464eb2813ebd1c2733e827(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:53:56,572 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:56,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:56,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:56,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. after waiting 0 ms 2023-02-13 04:53:56,573 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1676264035687; duration=0sec 2023-02-13 04:53:56,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:56,573 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:53:56,578 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/f4b82ebd88bb4b7aafe61352bdc1d439, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/2002ea433e7f4d2da2b09c9e5884fd4f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/e8a5330afcf64cd5b1b060b17708f3d7_SeqId_47_] to archive 2023-02-13 04:53:56,584 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:53:56,587 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/f4b82ebd88bb4b7aafe61352bdc1d439 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/f4b82ebd88bb4b7aafe61352bdc1d439 2023-02-13 04:53:56,589 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/2002ea433e7f4d2da2b09c9e5884fd4f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/2002ea433e7f4d2da2b09c9e5884fd4f 2023-02-13 04:53:56,591 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/e8a5330afcf64cd5b1b060b17708f3d7_SeqId_47_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/e8a5330afcf64cd5b1b060b17708f3d7_SeqId_47_ 2023-02-13 04:53:56,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 04:53:56,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:56,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6d63ec892cabd8db21fc52a71cc505d3: Waiting for close lock at 1676264036056Running coprocessor pre-close hooks at 1676264036056Disabling compacts and flushes for region at 1676264036056Disabling writes for close at 1676264036573 (+517 ms)Writing region close event to WAL at 1676264036602 (+29 ms)Running coprocessor post-close hooks at 1676264036607 (+5 ms)Closed at 1676264036608 (+1 ms) 2023-02-13 04:53:56,608 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 6d63ec892cabd8db21fc52a71cc505d3 to self. 2023-02-13 04:53:56,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:56,611 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6d63ec892cabd8db21fc52a71cc505d3, regionState=CLOSED 2023-02-13 04:53:56,612 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676264036611"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264036611"}]},"ts":"1676264036611"} 2023-02-13 04:53:56,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 04:53:56,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 6d63ec892cabd8db21fc52a71cc505d3, server=jenkins-hbase4.apache.org,37513,1676264019660 in 717 msec 2023-02-13 04:53:56,617 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6d63ec892cabd8db21fc52a71cc505d3, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=true 2023-02-13 04:53:56,768 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6d63ec892cabd8db21fc52a71cc505d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:56,768 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676264036768"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264036768"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264036768"}]},"ts":"1676264036768"} 2023-02-13 04:53:56,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 6d63ec892cabd8db21fc52a71cc505d3, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:53:56,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:56,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6d63ec892cabd8db21fc52a71cc505d3, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:53:56,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:56,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:56,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:56,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:56,931 INFO [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:56,932 DEBUG [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:56,932 DEBUG [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:56,933 INFO [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d63ec892cabd8db21fc52a71cc505d3 columnFamilyName family1 2023-02-13 04:53:56,940 DEBUG [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/da65a38db7464eb2813ebd1c2733e827 2023-02-13 04:53:56,941 INFO [StoreOpener-6d63ec892cabd8db21fc52a71cc505d3-1] regionserver.HStore(310): Store=6d63ec892cabd8db21fc52a71cc505d3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:56,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:56,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:56,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:53:56,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6d63ec892cabd8db21fc52a71cc505d3; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62727892, jitterRate=-0.06528156995773315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:53:56,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6d63ec892cabd8db21fc52a71cc505d3: Running coprocessor pre-open hook at 1676264036929Writing region info on filesystem at 1676264036929Initializing all the Stores at 1676264036930 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676264036930Cleaning up temporary data from old regions at 1676264036944 (+14 ms)Cleaning up detritus from prior splits at 1676264036945 (+1 ms)Running coprocessor post-open hooks at 1676264036948 (+3 ms)Region opened successfully at 1676264036948 2023-02-13 04:53:56,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3., pid=17, masterSystemTime=1676264036923 2023-02-13 04:53:56,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:56,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:53:56,951 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6d63ec892cabd8db21fc52a71cc505d3, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:56,952 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676264036951"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264036951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264036951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264036951"}]},"ts":"1676264036951"} 2023-02-13 04:53:56,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-13 04:53:56,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 6d63ec892cabd8db21fc52a71cc505d3, server=jenkins-hbase4.apache.org,37513,1676264019660 in 182 msec 2023-02-13 04:53:56,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-13 04:53:56,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=6d63ec892cabd8db21fc52a71cc505d3, REOPEN/MOVE in 1.0630 sec 2023-02-13 04:53:56,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-13 04:53:56,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0800 sec 2023-02-13 04:53:56,963 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.1090 sec 2023-02-13 04:53:56,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-13 04:53:56,972 INFO [Listener at localhost/37751] compactions.TestMobCompactor(278): alter status finished 2023-02-13 04:53:56,973 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 04:53:56,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 04:53:56,976 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 04:53:56,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:53:56,977 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264636977 2023-02-13 04:53:56,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:53:56,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 04:53:56,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:56,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x68fddbb0 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:53:56,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b36ce8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:53:56,985 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:56,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:56,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:56,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:56,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:57,822 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112893b0ddbb171c451d8dde694f3b33a27a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112893b0ddbb171c451d8dde694f3b33a27a 2023-02-13 04:53:57,823 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:57,835 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:53:57,838 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56456, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:53:57,845 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:53:57,847 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36870, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:53:57,858 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/09e21089f7c84c7aadb96aeece23e65b first=Optional[r05] last=Optional[r8] 2023-02-13 04:53:57,859 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/09e21089f7c84c7aadb96aeece23e65b}] 2023-02-13 04:53:57,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/09e21089f7c84c7aadb96aeece23e65b for inclusion in 6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:57,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 04:53:57,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:53:57,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 6d63ec892cabd8db21fc52a71cc505d3: 2023-02-13 04:53:57,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/09e21089f7c84c7aadb96aeece23e65b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6ro4iirfkok8m96ndvuttskfgjbtupkpv6evpbnbnpl29tn0bvhh90onh64kk74p/family1/09e21089f7c84c7aadb96aeece23e65b 2023-02-13 04:53:57,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6ro4iirfkok8m96ndvuttskfgjbtupkpv6evpbnbnpl29tn0bvhh90onh64kk74p/family1/09e21089f7c84c7aadb96aeece23e65b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/d9043a8224864b738487cae4d1413516_SeqId_53_ 2023-02-13 04:53:57,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6ro4iirfkok8m96ndvuttskfgjbtupkpv6evpbnbnpl29tn0bvhh90onh64kk74p/family1/09e21089f7c84c7aadb96aeece23e65b into 6d63ec892cabd8db21fc52a71cc505d3/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/d9043a8224864b738487cae4d1413516_SeqId_53_ - updating store file list. 2023-02-13 04:53:57,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/d9043a8224864b738487cae4d1413516_SeqId_53_ into 6d63ec892cabd8db21fc52a71cc505d3/family1 2023-02-13 04:53:57,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6ro4iirfkok8m96ndvuttskfgjbtupkpv6evpbnbnpl29tn0bvhh90onh64kk74p/family1/09e21089f7c84c7aadb96aeece23e65b into 6d63ec892cabd8db21fc52a71cc505d3/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/family1/d9043a8224864b738487cae4d1413516_SeqId_53_) 2023-02-13 04:53:57,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__6ro4iirfkok8m96ndvuttskfgjbtupkpv6evpbnbnpl29tn0bvhh90onh64kk74p/family1/09e21089f7c84c7aadb96aeece23e65b 2023-02-13 04:53:57,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:57,883 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:53:57,885 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b06844615f3c42258d3b00475f5da27a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b06844615f3c42258d3b00475f5da27a 2023-02-13 04:53:57,886 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285bfd90ad52a945fdb4fcafc41f320d4b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285bfd90ad52a945fdb4fcafc41f320d4b 2023-02-13 04:53:57,886 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-13 04:53:57,887 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 04:53:57,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:57,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:57,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 04:53:57,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 04:53:57,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:53:57,888 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 04:53:57,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 914 msec 2023-02-13 04:53:57,992 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=245 (was 209) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c00ecd7-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54862@0x40b18af3-SendThread(127.0.0.1:54862) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54862@0x68fddbb0-SendThread(127.0.0.1:54862) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54862@0x68fddbb0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1331355395.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47240 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1979218720_15 at /127.0.0.1:47102 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47186 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47200 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47106 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47160 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47086 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c00ecd7-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47074 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:37513-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54862@0x40b18af3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1331355395.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c00ecd7-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:37752 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d9057b9-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4d9057b9-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47122 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:37720 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47194 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47144 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47252 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54862@0x40b18af3-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47190 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54862@0x68fddbb0-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=591 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 305), ProcessCount=168 (was 168), AvailableMemoryMB=3980 (was 4305) 2023-02-13 04:53:58,005 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=245, OpenFileDescriptor=591, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=168, AvailableMemoryMB=3979 2023-02-13 04:53:58,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 04:53:58,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:58,010 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:53:58,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-13 04:53:58,012 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:53:58,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 04:53:58,013 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210 2023-02-13 04:53:58,014 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210 empty. 2023-02-13 04:53:58,015 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210 2023-02-13 04:53:58,015 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-13 04:53:58,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 04:53:58,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 04:53:58,424 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 04:53:58,426 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2b73a7398b958006c5f263c04e379210, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:53:58,436 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:58,436 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 2b73a7398b958006c5f263c04e379210, disabling compactions & flushes 2023-02-13 04:53:58,436 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:58,436 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:58,436 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. after waiting 0 ms 2023-02-13 04:53:58,436 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:58,436 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:58,436 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 2b73a7398b958006c5f263c04e379210: Waiting for close lock at 1676264038436Disabling compacts and flushes for region at 1676264038436Disabling writes for close at 1676264038436Writing region close event to WAL at 1676264038436Closed at 1676264038436 2023-02-13 04:53:58,439 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:53:58,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676264038440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264038440"}]},"ts":"1676264038440"} 2023-02-13 04:53:58,442 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:53:58,443 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:53:58,443 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264038443"}]},"ts":"1676264038443"} 2023-02-13 04:53:58,445 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 04:53:58,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2b73a7398b958006c5f263c04e379210, ASSIGN}] 2023-02-13 04:53:58,449 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2b73a7398b958006c5f263c04e379210, ASSIGN 2023-02-13 04:53:58,450 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2b73a7398b958006c5f263c04e379210, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:53:58,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2b73a7398b958006c5f263c04e379210, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:58,601 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676264038601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264038601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264038601"}]},"ts":"1676264038601"} 2023-02-13 04:53:58,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 2b73a7398b958006c5f263c04e379210, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:53:58,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 04:53:58,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:58,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2b73a7398b958006c5f263c04e379210, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:53:58,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 2b73a7398b958006c5f263c04e379210 2023-02-13 04:53:58,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:53:58,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2b73a7398b958006c5f263c04e379210 2023-02-13 04:53:58,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2b73a7398b958006c5f263c04e379210 2023-02-13 04:53:58,761 INFO [StoreOpener-2b73a7398b958006c5f263c04e379210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2b73a7398b958006c5f263c04e379210 2023-02-13 04:53:58,763 DEBUG [StoreOpener-2b73a7398b958006c5f263c04e379210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1 2023-02-13 04:53:58,763 DEBUG [StoreOpener-2b73a7398b958006c5f263c04e379210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1 2023-02-13 04:53:58,764 INFO [StoreOpener-2b73a7398b958006c5f263c04e379210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b73a7398b958006c5f263c04e379210 columnFamilyName family1 2023-02-13 04:53:58,766 INFO [StoreOpener-2b73a7398b958006c5f263c04e379210-1] regionserver.HStore(310): Store=2b73a7398b958006c5f263c04e379210/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:53:58,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210 2023-02-13 04:53:58,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210 2023-02-13 04:53:58,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2b73a7398b958006c5f263c04e379210 2023-02-13 04:53:58,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:53:58,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2b73a7398b958006c5f263c04e379210; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64753458, jitterRate=-0.03509828448295593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:53:58,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2b73a7398b958006c5f263c04e379210: Running coprocessor pre-open hook at 1676264038760Writing region info on filesystem at 1676264038760Initializing all the Stores at 1676264038761 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676264038761Cleaning up temporary data from old regions at 1676264038768 (+7 ms)Cleaning up detritus from prior splits at 1676264038769 (+1 ms)Running coprocessor post-open hooks at 1676264038774 (+5 ms)Region opened successfully at 1676264038774 2023-02-13 04:53:58,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210., pid=21, masterSystemTime=1676264038756 2023-02-13 04:53:58,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:58,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:58,777 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2b73a7398b958006c5f263c04e379210, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:58,777 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676264038777"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264038777"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264038777"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264038777"}]},"ts":"1676264038777"} 2023-02-13 04:53:58,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-13 04:53:58,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 2b73a7398b958006c5f263c04e379210, server=jenkins-hbase4.apache.org,37513,1676264019660 in 176 msec 2023-02-13 04:53:58,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-13 04:53:58,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2b73a7398b958006c5f263c04e379210, ASSIGN in 333 msec 2023-02-13 04:53:58,784 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:53:58,784 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264038784"}]},"ts":"1676264038784"} 2023-02-13 04:53:58,785 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 04:53:58,787 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:53:58,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 780 msec 2023-02-13 04:53:59,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 04:53:59,117 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-13 04:53:59,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:59,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,164 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:53:59,164 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:59,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:53:59,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:53:59,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,167 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:59,167 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:59,167 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,167 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:59,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,169 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,169 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,169 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:53:59,169 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:59,169 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:53:59,170 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:59,170 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:59,170 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:59,170 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:53:59,170 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 04:53:59,204 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ed7fd53900834233a07cab7ad8fc7d69 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ed7fd53900834233a07cab7ad8fc7d69 2023-02-13 04:53:59,208 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/05cddf8d589841c29a514a019994f23d 2023-02-13 04:53:59,215 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/05cddf8d589841c29a514a019994f23d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/05cddf8d589841c29a514a019994f23d 2023-02-13 04:53:59,221 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/05cddf8d589841c29a514a019994f23d, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 04:53:59,222 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 52ms, sequenceid=5, compaction requested=false 2023-02-13 04:53:59,222 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:53:59,223 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:53:59,223 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:59,223 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:59,223 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:59,223 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,223 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:53:59,224 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:53:59,225 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,225 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:59,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:59,226 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,226 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:59,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:59,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:59,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:59,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:53:59,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27d9cbf3[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:59,228 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:53:59,228 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,229 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,229 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:53:59,229 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:53:59,229 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:59,229 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,229 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:59,232 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,232 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:53:59,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:59,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:59,232 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:59,232 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:53:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:59,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:59,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:59,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:53:59,236 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:53:59,236 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:59,236 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:59,236 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,236 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:59,237 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,237 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:59,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:59,238 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:59,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,238 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:59,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:59,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:59,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:59,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,240 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,242 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,242 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,242 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,242 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,242 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:53:59,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:59,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:53:59,243 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:59,243 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,242 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:59,243 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:59,244 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:59,243 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:59,244 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:59,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:59,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:59,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:59,344 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:59,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:59,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:59,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:59,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,354 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:53:59,354 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:59,354 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:53:59,354 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:53:59,355 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,355 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,357 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:59,357 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:59,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:59,357 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,358 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:59,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:59,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,359 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,359 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:53:59,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,359 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:53:59,359 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:59,360 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:53:59,360 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:59,360 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:59,360 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:59,360 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:53:59,360 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 04:53:59,381 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b5954dbe5b5a4aca833239e9acfe0c5c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128b5954dbe5b5a4aca833239e9acfe0c5c 2023-02-13 04:53:59,388 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/9fd14b4619084e198880e2be7efafe10 2023-02-13 04:53:59,395 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/9fd14b4619084e198880e2be7efafe10 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9fd14b4619084e198880e2be7efafe10 2023-02-13 04:53:59,404 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9fd14b4619084e198880e2be7efafe10, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 04:53:59,406 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 45ms, sequenceid=9, compaction requested=false 2023-02-13 04:53:59,406 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:53:59,406 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:53:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:53:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:53:59,406 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:53:59,408 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:53:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:59,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:53:59,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48b8b5d9[Count = 0] remaining members to acquire global barrier 2023-02-13 04:53:59,410 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:53:59,410 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,411 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,411 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:53:59,412 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:53:59,412 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:53:59,412 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,412 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:53:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:53:59,413 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:53:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:53:59,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:53:59,417 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:53:59,417 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:53:59,417 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:53:59,417 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,417 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:53:59,420 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,420 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:53:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:53:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,420 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:59,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:53:59,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:59,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:59,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:53:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:53:59,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,424 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,425 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,430 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,430 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:59,430 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,430 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:53:59,430 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:53:59,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:53:59,430 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,430 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:53:59,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:59,430 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:59,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,431 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:53:59,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,431 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:53:59,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:53:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:53:59,532 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:53:59,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:53:59,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:53:59,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:53:59,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,540 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:53:59,540 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:59,540 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:53:59,540 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:53:59,541 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,541 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,542 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,542 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:53:59,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:53:59,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:53:59,543 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:53:59,543 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:53:59,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:53:59,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,543 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:53:59,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:53:59,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:53:59,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:53:59,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:53:59,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:53:59,545 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:53:59,545 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:53:59,545 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:53:59,545 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:53:59,960 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a807c793c2764cebaf9995f9cfaa8702 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201a807c793c2764cebaf9995f9cfaa8702 2023-02-13 04:54:00,366 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/c34d56e771a14299b5f0bae3695bf112 2023-02-13 04:54:00,373 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/c34d56e771a14299b5f0bae3695bf112 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/c34d56e771a14299b5f0bae3695bf112 2023-02-13 04:54:00,379 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/c34d56e771a14299b5f0bae3695bf112, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 04:54:00,380 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 835ms, sequenceid=13, compaction requested=true 2023-02-13 04:54:00,380 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:00,380 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:54:00,380 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:54:00,382 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,382 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:00,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:00,382 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,382 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:00,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:00,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:54:00,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b7366dd[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:00,384 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:00,384 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,385 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,385 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:00,385 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:54:00,385 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:00,385 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,385 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:00,387 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:54:00,387 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:00,387 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,387 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:54:00,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:00,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:00,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:00,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:00,390 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:54:00,390 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:00,391 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:00,391 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,391 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:00,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:00,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:00,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:00,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:00,401 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:00,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,402 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:00,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,404 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:00,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:00,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:00,405 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:00,405 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,405 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,405 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,405 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,405 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,405 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:00,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:00,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:00,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:00,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:00,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:54:00,405 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,406 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,406 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:00,406 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:00,506 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:00,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:00,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:00,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:00,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,514 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:00,514 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:00,514 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:54:00,514 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:00,515 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,515 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,516 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,516 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:00,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:00,516 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,516 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,517 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,517 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:54:00,517 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,517 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:54:00,517 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:00,518 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:54:00,518 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:00,518 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:00,518 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:00,518 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:54:00,518 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:00,934 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120567b0af8ba0bb4abbb51047f23bd63399 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120567b0af8ba0bb4abbb51047f23bd63399 2023-02-13 04:54:00,940 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/49e121c640ee448293cff7b6c6c456c8 2023-02-13 04:54:00,947 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/49e121c640ee448293cff7b6c6c456c8 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/49e121c640ee448293cff7b6c6c456c8 2023-02-13 04:54:00,952 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/49e121c640ee448293cff7b6c6c456c8, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 04:54:00,953 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 435ms, sequenceid=17, compaction requested=true 2023-02-13 04:54:00,953 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:00,953 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:54:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:54:00,955 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,955 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:00,955 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,955 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:00,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:54:00,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c5f37dc[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:00,957 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:00,957 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,959 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:00,959 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:54:00,959 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:00,960 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:54:00,960 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,960 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:00,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:00,960 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:54:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:00,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:00,963 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:54:00,963 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:00,963 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:00,963 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,963 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:00,965 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,965 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:00,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,965 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:00,965 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,967 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,969 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,969 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,969 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,969 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:00,969 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:00,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:54:00,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:00,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:00,969 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:00,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:00,969 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:00,970 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,970 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,970 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:00,970 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:00,970 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:00,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:00,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:01,070 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:01,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:01,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:01,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:01,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,079 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:01,079 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:01,080 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:54:01,080 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:01,080 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,080 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,082 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,082 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:01,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:01,083 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,083 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,084 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,084 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:54:01,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,084 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:54:01,084 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:01,085 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:54:01,085 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:01,085 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:01,085 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:01,085 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:54:01,085 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:01,105 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228097e57524a6a43e0bdcedb6bb0d29c17 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228097e57524a6a43e0bdcedb6bb0d29c17 2023-02-13 04:54:01,112 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/1557007680b942ab8e7a45aea8024dd4 2023-02-13 04:54:01,118 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/1557007680b942ab8e7a45aea8024dd4 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/1557007680b942ab8e7a45aea8024dd4 2023-02-13 04:54:01,123 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/1557007680b942ab8e7a45aea8024dd4, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 04:54:01,124 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 39ms, sequenceid=21, compaction requested=true 2023-02-13 04:54:01,124 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:01,124 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:54:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:54:01,126 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,126 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:01,126 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,126 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:01,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:01,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:01,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:54:01,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7530f1f7[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:01,128 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:01,128 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,129 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:54:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:01,129 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,129 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:01,131 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:54:01,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:01,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:01,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:54:01,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:01,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:01,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:01,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:01,135 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:54:01,135 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:01,135 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:01,135 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,135 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:01,142 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,142 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:01,142 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:01,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:01,143 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:01,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,144 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:01,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:01,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:01,147 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:01,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:01,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:01,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:01,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:01,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:54:01,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:01,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:01,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,148 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:01,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,148 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:01,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,249 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:01,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:01,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:01,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:01,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,256 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:01,256 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:01,257 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:54:01,257 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:01,257 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,257 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,258 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,258 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:01,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:01,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:01,259 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:01,259 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:01,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:01,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,260 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:54:01,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:01,260 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:54:01,260 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:01,260 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:54:01,261 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:01,261 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:01,261 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:01,261 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:54:01,261 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:01,677 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123191423007237b4548873ddc2d71677942 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123191423007237b4548873ddc2d71677942 2023-02-13 04:54:02,084 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/a1fc7f114b7d43f09975261f532f69cc 2023-02-13 04:54:02,090 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/a1fc7f114b7d43f09975261f532f69cc as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1fc7f114b7d43f09975261f532f69cc 2023-02-13 04:54:02,096 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1fc7f114b7d43f09975261f532f69cc, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 04:54:02,097 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 836ms, sequenceid=25, compaction requested=true 2023-02-13 04:54:02,097 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:02,097 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:02,097 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:02,097 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:02,097 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,097 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:54:02,097 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:54:02,100 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:02,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:02,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:02,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:02,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:02,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:54:02,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@782b94f5[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:02,102 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:02,102 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,103 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,103 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:02,103 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,103 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:02,103 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:54:02,103 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:02,105 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:54:02,105 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,105 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:02,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:02,105 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:54:02,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:02,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:02,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:02,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:02,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:02,108 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:54:02,108 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:02,108 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:02,108 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,108 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:02,110 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,110 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:02,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:02,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,110 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:02,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:02,110 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,112 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,115 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,115 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,115 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,115 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:02,115 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:02,115 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:02,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:54:02,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:02,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:02,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:02,115 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,115 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:02,116 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,116 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:02,116 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:02,117 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:02,144 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:54:02,217 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:02,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:02,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:02,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:02,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,224 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:02,224 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:02,225 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:54:02,225 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:02,226 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,226 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,227 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,227 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:02,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:02,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:02,228 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,228 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:02,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:02,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,229 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,229 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:54:02,229 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,229 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:54:02,229 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:02,230 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:54:02,230 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:02,230 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:02,230 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:02,230 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:54:02,230 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:02,248 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601014339a3c75cf34c11a9b7ae20d932a2d4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014339a3c75cf34c11a9b7ae20d932a2d4 2023-02-13 04:54:02,258 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/bce853ed5836436bb8b564bc44602bfe 2023-02-13 04:54:02,265 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/bce853ed5836436bb8b564bc44602bfe as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/bce853ed5836436bb8b564bc44602bfe 2023-02-13 04:54:02,271 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/bce853ed5836436bb8b564bc44602bfe, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 04:54:02,272 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 42ms, sequenceid=29, compaction requested=true 2023-02-13 04:54:02,272 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:02,272 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:54:02,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:54:02,274 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,274 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:02,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:02,274 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,274 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:02,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:02,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:02,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:54:02,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@180e50a3[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:02,276 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:02,276 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,277 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,277 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:02,277 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:54:02,277 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:02,277 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,277 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:02,280 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:54:02,280 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:02,280 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,280 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:54:02,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:02,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:02,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:02,283 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:54:02,283 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:02,283 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:02,283 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,283 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:02,285 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,285 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,285 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:02,285 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:02,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:02,286 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:02,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:02,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:02,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,289 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:54:02,289 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:02,290 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:02,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:02,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:02,390 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:02,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:02,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:02,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:02,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,399 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:02,399 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:02,400 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:54:02,400 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:02,400 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,400 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,401 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:02,401 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:02,402 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,402 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,402 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:54:02,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,404 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:54:02,404 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:02,404 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:54:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:02,405 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:02,405 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:02,405 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:54:02,405 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:02,418 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010357ebd0ddf1e141bbb051cd234ded3843 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010357ebd0ddf1e141bbb051cd234ded3843 2023-02-13 04:54:02,824 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/3fc39798d95149a8af5d0cddd082d689 2023-02-13 04:54:02,831 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/3fc39798d95149a8af5d0cddd082d689 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/3fc39798d95149a8af5d0cddd082d689 2023-02-13 04:54:02,837 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/3fc39798d95149a8af5d0cddd082d689, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 04:54:02,838 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 433ms, sequenceid=33, compaction requested=true 2023-02-13 04:54:02,838 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:02,839 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:54:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:54:02,841 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,841 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:02,842 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,842 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:02,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:54:02,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d8a65a9[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:02,844 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:02,844 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,845 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,845 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:02,845 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:54:02,845 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:02,846 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,846 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:02,853 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,853 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:54:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:02,853 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:02,854 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:54:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:02,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:02,857 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:54:02,857 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:02,857 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:02,857 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,857 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:02,859 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,859 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:02,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,859 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:02,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:02,860 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,861 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,864 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,864 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:02,864 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:02,864 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,864 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:02,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:54:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:02,864 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:02,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:02,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:02,864 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,865 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,865 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,865 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:02,865 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:02,865 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:02,965 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:02,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:02,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:02,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:02,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,974 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:02,974 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:02,974 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:54:02,975 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:02,975 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,975 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,977 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,977 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:02,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:02,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:02,978 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:02,978 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,979 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,979 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:54:02,979 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:02,979 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:54:02,979 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:54:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:02,980 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:02,980 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:54:02,980 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:03,402 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907200712995029447993c56b0a7250d0f4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907200712995029447993c56b0a7250d0f4 2023-02-13 04:54:03,813 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/9b4c72e5f54f4ec69f08a8cfa3f6cc60 2023-02-13 04:54:03,819 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/9b4c72e5f54f4ec69f08a8cfa3f6cc60 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9b4c72e5f54f4ec69f08a8cfa3f6cc60 2023-02-13 04:54:03,824 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9b4c72e5f54f4ec69f08a8cfa3f6cc60, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 04:54:03,825 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 845ms, sequenceid=37, compaction requested=true 2023-02-13 04:54:03,825 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:03,825 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:54:03,826 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:54:03,827 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,827 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:03,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:03,828 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,828 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:54:03,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fc79ca6[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:03,829 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:03,829 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,830 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,830 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:03,830 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:54:03,830 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,830 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:03,830 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:03,832 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:54:03,832 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,832 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,832 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:54:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:03,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:03,834 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:54:03,834 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:03,834 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:03,835 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,835 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:03,838 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,838 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,838 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:03,838 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:03,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:03,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,839 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,841 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,841 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:03,842 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:03,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:03,842 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:03,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:54:03,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:03,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:03,842 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:03,842 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:03,843 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:03,843 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,843 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:03,843 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,843 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:03,843 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,943 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:03,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:03,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:03,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:03,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,950 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:03,950 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:03,951 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:54:03,951 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:03,951 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,951 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,952 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,952 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:03,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:03,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:03,953 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:03,953 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,953 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,954 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:54:03,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:03,954 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:54:03,954 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:03,955 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:54:03,955 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:03,955 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:03,955 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:03,955 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. started... 2023-02-13 04:54:03,955 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b73a7398b958006c5f263c04e379210 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:04,370 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c988c171c3a243aa8e03636c5d4c7f3c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120c988c171c3a243aa8e03636c5d4c7f3c 2023-02-13 04:54:04,776 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/2d79d4dcd7a24dc0b7ba317e81e44692 2023-02-13 04:54:04,782 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/2d79d4dcd7a24dc0b7ba317e81e44692 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/2d79d4dcd7a24dc0b7ba317e81e44692 2023-02-13 04:54:04,787 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/2d79d4dcd7a24dc0b7ba317e81e44692, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 04:54:04,788 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2b73a7398b958006c5f263c04e379210 in 833ms, sequenceid=41, compaction requested=true 2023-02-13 04:54:04,788 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:04,788 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:54:04,788 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:54:04,790 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,790 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:04,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:04,790 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,790 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:04,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:04,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:04,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:54:04,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b6f3d97[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:04,792 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:04,792 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,798 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,798 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:04,798 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:54:04,798 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,798 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:04,798 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:04,799 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,799 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:54:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:04,799 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:04,800 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:54:04,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:04,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:04,802 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:54:04,802 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:04,802 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:04,802 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,802 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:04,803 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,803 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,804 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:04,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:04,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:04,804 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,805 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:04,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,807 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,807 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:04,807 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:04,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 04:54:04,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:04,807 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:04,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:04,807 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,807 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:04,808 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:04,808 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,808 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:04,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:04,809 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,809 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:04,809 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,909 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:04,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:04,911 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-13 04:54:04,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:54:04,914 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:54:04,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:04,915 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264644915 2023-02-13 04:54:04,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:54:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 04:54:04,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:54:04,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x6641104d to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:54:04,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b5ee0b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:54:04,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:54:05,755 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034b1d8c9766bb42aeaddf1d31a4ae9a36 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601034b1d8c9766bb42aeaddf1d31a4ae9a36 2023-02-13 04:54:05,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:54:05,769 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:54:05,770 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38728, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:54:05,777 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:54:05,778 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55742, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:54:05,787 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/8d3b541aedf3459cb0df2caea06c7611 first=Optional[r5] last=Optional[r6] 2023-02-13 04:54:05,788 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/8d3b541aedf3459cb0df2caea06c7611}] 2023-02-13 04:54:05,792 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/8d3b541aedf3459cb0df2caea06c7611 for inclusion in 2b73a7398b958006c5f263c04e379210/family1 2023-02-13 04:54:05,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 04:54:05,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:05,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:05,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/8d3b541aedf3459cb0df2caea06c7611 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o8b05k3nn14parqvuo8kb6ml7q1bgn507jbsud17ia2jm6823e2fvo8cb0l1e1u9/family1/8d3b541aedf3459cb0df2caea06c7611 2023-02-13 04:54:05,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o8b05k3nn14parqvuo8kb6ml7q1bgn507jbsud17ia2jm6823e2fvo8cb0l1e1u9/family1/8d3b541aedf3459cb0df2caea06c7611 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/ffdffc27e8d5447d9f1a85b4bbf19c61_SeqId_44_ 2023-02-13 04:54:05,799 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o8b05k3nn14parqvuo8kb6ml7q1bgn507jbsud17ia2jm6823e2fvo8cb0l1e1u9/family1/8d3b541aedf3459cb0df2caea06c7611 into 2b73a7398b958006c5f263c04e379210/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/ffdffc27e8d5447d9f1a85b4bbf19c61_SeqId_44_ - updating store file list. 2023-02-13 04:54:05,803 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/ffdffc27e8d5447d9f1a85b4bbf19c61_SeqId_44_ into 2b73a7398b958006c5f263c04e379210/family1 2023-02-13 04:54:05,803 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o8b05k3nn14parqvuo8kb6ml7q1bgn507jbsud17ia2jm6823e2fvo8cb0l1e1u9/family1/8d3b541aedf3459cb0df2caea06c7611 into 2b73a7398b958006c5f263c04e379210/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/ffdffc27e8d5447d9f1a85b4bbf19c61_SeqId_44_) 2023-02-13 04:54:05,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o8b05k3nn14parqvuo8kb6ml7q1bgn507jbsud17ia2jm6823e2fvo8cb0l1e1u9/family1/8d3b541aedf3459cb0df2caea06c7611 2023-02-13 04:54:05,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 04:54:05,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 04:54:05,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): 2b73a7398b958006c5f263c04e379210/family1 is initiating minor compaction 2023-02-13 04:54:05,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@62d0f61b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:05,808 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2b73a7398b958006c5f263c04e379210/family1 in testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:05,808 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9fd14b4619084e198880e2be7efafe10, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/c34d56e771a14299b5f0bae3695bf112, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/49e121c640ee448293cff7b6c6c456c8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/1557007680b942ab8e7a45aea8024dd4, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1fc7f114b7d43f09975261f532f69cc, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/bce853ed5836436bb8b564bc44602bfe, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/3fc39798d95149a8af5d0cddd082d689, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9b4c72e5f54f4ec69f08a8cfa3f6cc60, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/2d79d4dcd7a24dc0b7ba317e81e44692, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/ffdffc27e8d5447d9f1a85b4bbf19c61_SeqId_44_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp, totalSize=49.7 K 2023-02-13 04:54:05,808 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 9fd14b4619084e198880e2be7efafe10, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 04:54:05,809 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting c34d56e771a14299b5f0bae3695bf112, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 04:54:05,809 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 49e121c640ee448293cff7b6c6c456c8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 04:54:05,809 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 1557007680b942ab8e7a45aea8024dd4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 04:54:05,809 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting a1fc7f114b7d43f09975261f532f69cc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 04:54:05,809 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting bce853ed5836436bb8b564bc44602bfe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 04:54:05,809 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 3fc39798d95149a8af5d0cddd082d689, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 04:54:05,809 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 9b4c72e5f54f4ec69f08a8cfa3f6cc60, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 04:54:05,809 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 2d79d4dcd7a24dc0b7ba317e81e44692, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 04:54:05,809 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting ffdffc27e8d5447d9f1a85b4bbf19c61_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 04:54:05,811 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:54:05,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:05,813 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014339a3c75cf34c11a9b7ae20d932a2d4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014339a3c75cf34c11a9b7ae20d932a2d4 2023-02-13 04:54:05,815 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010357ebd0ddf1e141bbb051cd234ded3843 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010357ebd0ddf1e141bbb051cd234ded3843 2023-02-13 04:54:05,815 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 04:54:05,815 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 04:54:05,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:54:05,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:54:05,854 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2b73a7398b958006c5f263c04e379210#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:54:06,278 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317877bbd0c0794394acb6cc929a249f00 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317877bbd0c0794394acb6cc929a249f00 2023-02-13 04:54:06,279 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/a1c1f88bf2f947edb6b28ab59c9ef848 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1c1f88bf2f947edb6b28ab59c9ef848 2023-02-13 04:54:06,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:54:06,285 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2b73a7398b958006c5f263c04e379210/family1 of 2b73a7398b958006c5f263c04e379210 into a1c1f88bf2f947edb6b28ab59c9ef848(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:54:06,286 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:06,286 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676264045808; duration=0sec 2023-02-13 04:54:06,286 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:06,310 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1f2c1d54f69d49e1b09325f95b8a3edb first=Optional[r1] last=Optional[r4] 2023-02-13 04:54:06,310 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1f2c1d54f69d49e1b09325f95b8a3edb}] 2023-02-13 04:54:06,312 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1f2c1d54f69d49e1b09325f95b8a3edb for inclusion in 2b73a7398b958006c5f263c04e379210/family1 2023-02-13 04:54:06,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 04:54:06,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:06,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:06,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1f2c1d54f69d49e1b09325f95b8a3edb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u9k87oavmmtfbal73e6ktd7l7nrn4ue9epefvd72f3vuivtna8kh8bov7avd6eus/family1/1f2c1d54f69d49e1b09325f95b8a3edb 2023-02-13 04:54:06,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u9k87oavmmtfbal73e6ktd7l7nrn4ue9epefvd72f3vuivtna8kh8bov7avd6eus/family1/1f2c1d54f69d49e1b09325f95b8a3edb as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/6343084c9970424282a05b8d13d0cde0_SeqId_47_ 2023-02-13 04:54:06,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u9k87oavmmtfbal73e6ktd7l7nrn4ue9epefvd72f3vuivtna8kh8bov7avd6eus/family1/1f2c1d54f69d49e1b09325f95b8a3edb into 2b73a7398b958006c5f263c04e379210/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/6343084c9970424282a05b8d13d0cde0_SeqId_47_ - updating store file list. 2023-02-13 04:54:06,324 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/6343084c9970424282a05b8d13d0cde0_SeqId_47_ into 2b73a7398b958006c5f263c04e379210/family1 2023-02-13 04:54:06,324 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u9k87oavmmtfbal73e6ktd7l7nrn4ue9epefvd72f3vuivtna8kh8bov7avd6eus/family1/1f2c1d54f69d49e1b09325f95b8a3edb into 2b73a7398b958006c5f263c04e379210/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/6343084c9970424282a05b8d13d0cde0_SeqId_47_) 2023-02-13 04:54:06,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__u9k87oavmmtfbal73e6ktd7l7nrn4ue9epefvd72f3vuivtna8kh8bov7avd6eus/family1/1f2c1d54f69d49e1b09325f95b8a3edb 2023-02-13 04:54:06,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 04:54:06,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 04:54:06,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): 2b73a7398b958006c5f263c04e379210/family1 is initiating minor compaction (all files) 2023-02-13 04:54:06,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@266e1531; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:06,326 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2b73a7398b958006c5f263c04e379210/family1 in testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:54:06,326 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/05cddf8d589841c29a514a019994f23d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1c1f88bf2f947edb6b28ab59c9ef848, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/6343084c9970424282a05b8d13d0cde0_SeqId_47_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp, totalSize=178.1 K 2023-02-13 04:54:06,327 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 05cddf8d589841c29a514a019994f23d, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843565 2023-02-13 04:54:06,330 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting a1c1f88bf2f947edb6b28ab59c9ef848, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243565 2023-02-13 04:54:06,333 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 6343084c9970424282a05b8d13d0cde0_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965243565 2023-02-13 04:54:06,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:54:06,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9fd14b4619084e198880e2be7efafe10, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/c34d56e771a14299b5f0bae3695bf112, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/49e121c640ee448293cff7b6c6c456c8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/1557007680b942ab8e7a45aea8024dd4, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1fc7f114b7d43f09975261f532f69cc, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/bce853ed5836436bb8b564bc44602bfe, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/3fc39798d95149a8af5d0cddd082d689, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9b4c72e5f54f4ec69f08a8cfa3f6cc60, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/2d79d4dcd7a24dc0b7ba317e81e44692, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/ffdffc27e8d5447d9f1a85b4bbf19c61_SeqId_44_] to archive 2023-02-13 04:54:06,338 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:06,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:06,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9fd14b4619084e198880e2be7efafe10 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9fd14b4619084e198880e2be7efafe10 2023-02-13 04:54:06,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/c34d56e771a14299b5f0bae3695bf112 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/c34d56e771a14299b5f0bae3695bf112 2023-02-13 04:54:06,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/49e121c640ee448293cff7b6c6c456c8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/49e121c640ee448293cff7b6c6c456c8 2023-02-13 04:54:06,345 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201a807c793c2764cebaf9995f9cfaa8702 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201a807c793c2764cebaf9995f9cfaa8702 2023-02-13 04:54:06,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/1557007680b942ab8e7a45aea8024dd4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/1557007680b942ab8e7a45aea8024dd4 2023-02-13 04:54:06,346 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120567b0af8ba0bb4abbb51047f23bd63399 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120567b0af8ba0bb4abbb51047f23bd63399 2023-02-13 04:54:06,348 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228097e57524a6a43e0bdcedb6bb0d29c17 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228097e57524a6a43e0bdcedb6bb0d29c17 2023-02-13 04:54:06,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1fc7f114b7d43f09975261f532f69cc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1fc7f114b7d43f09975261f532f69cc 2023-02-13 04:54:06,349 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123191423007237b4548873ddc2d71677942 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123191423007237b4548873ddc2d71677942 2023-02-13 04:54:06,349 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 04:54:06,349 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 04:54:06,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/bce853ed5836436bb8b564bc44602bfe to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/bce853ed5836436bb8b564bc44602bfe 2023-02-13 04:54:06,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:54:06,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:54:06,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/3fc39798d95149a8af5d0cddd082d689 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/3fc39798d95149a8af5d0cddd082d689 2023-02-13 04:54:06,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9b4c72e5f54f4ec69f08a8cfa3f6cc60 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/9b4c72e5f54f4ec69f08a8cfa3f6cc60 2023-02-13 04:54:06,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/2d79d4dcd7a24dc0b7ba317e81e44692 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/2d79d4dcd7a24dc0b7ba317e81e44692 2023-02-13 04:54:06,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/ffdffc27e8d5447d9f1a85b4bbf19c61_SeqId_44_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/ffdffc27e8d5447d9f1a85b4bbf19c61_SeqId_44_ 2023-02-13 04:54:06,360 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2b73a7398b958006c5f263c04e379210#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:54:07,197 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/.tmp/family1/f9a3bf8d7c414f899b83d579e19307ac as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/f9a3bf8d7c414f899b83d579e19307ac 2023-02-13 04:54:07,204 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2b73a7398b958006c5f263c04e379210/family1 of 2b73a7398b958006c5f263c04e379210 into f9a3bf8d7c414f899b83d579e19307ac(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:54:07,204 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:07,204 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676264046326; duration=0sec 2023-02-13 04:54:07,204 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:07,220 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308d97e59bb8624b729c4b9696acb0035d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511308d97e59bb8624b729c4b9696acb0035d 2023-02-13 04:54:07,221 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:54:07,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/05cddf8d589841c29a514a019994f23d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1c1f88bf2f947edb6b28ab59c9ef848, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/6343084c9970424282a05b8d13d0cde0_SeqId_47_] to archive 2023-02-13 04:54:07,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:07,229 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/05cddf8d589841c29a514a019994f23d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/05cddf8d589841c29a514a019994f23d 2023-02-13 04:54:07,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1c1f88bf2f947edb6b28ab59c9ef848 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/a1c1f88bf2f947edb6b28ab59c9ef848 2023-02-13 04:54:07,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/6343084c9970424282a05b8d13d0cde0_SeqId_47_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/6343084c9970424282a05b8d13d0cde0_SeqId_47_ 2023-02-13 04:54:07,253 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f2c78cd5dadb4353884d85637a742a0d first=Optional[r00] last=Optional[r8] 2023-02-13 04:54:07,254 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f2c78cd5dadb4353884d85637a742a0d}] 2023-02-13 04:54:07,256 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f2c78cd5dadb4353884d85637a742a0d for inclusion in 2b73a7398b958006c5f263c04e379210/family1 2023-02-13 04:54:07,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 04:54:07,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:07,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 2b73a7398b958006c5f263c04e379210: 2023-02-13 04:54:07,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f2c78cd5dadb4353884d85637a742a0d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p69dh6hq6h9ug9ernskb4inbha05va1ai501llmek9q7dtbmuamghgptaf6s81gp/family1/f2c78cd5dadb4353884d85637a742a0d 2023-02-13 04:54:07,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p69dh6hq6h9ug9ernskb4inbha05va1ai501llmek9q7dtbmuamghgptaf6s81gp/family1/f2c78cd5dadb4353884d85637a742a0d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/61594ea976d6487fa7f26e2f43004445_SeqId_50_ 2023-02-13 04:54:07,263 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p69dh6hq6h9ug9ernskb4inbha05va1ai501llmek9q7dtbmuamghgptaf6s81gp/family1/f2c78cd5dadb4353884d85637a742a0d into 2b73a7398b958006c5f263c04e379210/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/61594ea976d6487fa7f26e2f43004445_SeqId_50_ - updating store file list. 2023-02-13 04:54:07,268 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/61594ea976d6487fa7f26e2f43004445_SeqId_50_ into 2b73a7398b958006c5f263c04e379210/family1 2023-02-13 04:54:07,268 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p69dh6hq6h9ug9ernskb4inbha05va1ai501llmek9q7dtbmuamghgptaf6s81gp/family1/f2c78cd5dadb4353884d85637a742a0d into 2b73a7398b958006c5f263c04e379210/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/family1/61594ea976d6487fa7f26e2f43004445_SeqId_50_) 2023-02-13 04:54:07,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p69dh6hq6h9ug9ernskb4inbha05va1ai501llmek9q7dtbmuamghgptaf6s81gp/family1/f2c78cd5dadb4353884d85637a742a0d 2023-02-13 04:54:07,271 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:54:07,271 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:07,273 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120c988c171c3a243aa8e03636c5d4c7f3c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120c988c171c3a243aa8e03636c5d4c7f3c 2023-02-13 04:54:07,274 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128b5954dbe5b5a4aca833239e9acfe0c5c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128b5954dbe5b5a4aca833239e9acfe0c5c 2023-02-13 04:54:07,275 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ed7fd53900834233a07cab7ad8fc7d69 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ed7fd53900834233a07cab7ad8fc7d69 2023-02-13 04:54:07,275 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 04:54:07,275 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 04:54:07,276 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:54:07,276 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:54:07,276 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:54:07,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:54:07,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:07,277 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:54:07,279 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.3650 sec 2023-02-13 04:54:07,370 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252 (was 245) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54862@0x6641104d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x83d55d-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57726 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57626 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57772 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x83d55d-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57870 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:47186 [Waiting for operation #31] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57758 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1979218720_15 at /127.0.0.1:57608 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57680 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x83d55d-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57710 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54862@0x6641104d sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1331355395.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54862@0x6641104d-SendThread(127.0.0.1:54862) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x83d55d-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57584 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/cluster_98a6d5ea-75e8-c972-88d1-3a74142f0e58/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/cluster_98a6d5ea-75e8-c972-88d1-3a74142f0e58/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57840 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57640 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x83d55d-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x83d55d-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57644 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x83d55d-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1454721095_15 at /127.0.0.1:57748 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=611 (was 591) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 279), ProcessCount=168 (was 168), AvailableMemoryMB=4493 (was 3979) - AvailableMemoryMB LEAK? - 2023-02-13 04:54:07,383 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=252, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=168, AvailableMemoryMB=4491 2023-02-13 04:54:07,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 04:54:07,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:07,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:54:07,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-13 04:54:07,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:54:07,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 04:54:07,392 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:54:07,393 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a empty. 2023-02-13 04:54:07,393 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:54:07,393 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-13 04:54:07,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 04:54:07,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 04:54:07,803 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 04:54:07,804 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 884e4256c9aa5930bdd891bcf997257a, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:54:07,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 04:54:08,211 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:08,211 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 884e4256c9aa5930bdd891bcf997257a, disabling compactions & flushes 2023-02-13 04:54:08,211 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:08,211 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:08,211 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. after waiting 0 ms 2023-02-13 04:54:08,211 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:08,211 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:08,211 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 884e4256c9aa5930bdd891bcf997257a: Waiting for close lock at 1676264048211Disabling compacts and flushes for region at 1676264048211Disabling writes for close at 1676264048211Writing region close event to WAL at 1676264048211Closed at 1676264048211 2023-02-13 04:54:08,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:54:08,215 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676264048215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264048215"}]},"ts":"1676264048215"} 2023-02-13 04:54:08,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:54:08,217 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:54:08,217 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264048217"}]},"ts":"1676264048217"} 2023-02-13 04:54:08,219 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 04:54:08,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=884e4256c9aa5930bdd891bcf997257a, ASSIGN}] 2023-02-13 04:54:08,228 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=884e4256c9aa5930bdd891bcf997257a, ASSIGN 2023-02-13 04:54:08,228 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=884e4256c9aa5930bdd891bcf997257a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:54:08,379 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=884e4256c9aa5930bdd891bcf997257a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:08,380 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676264048379"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264048379"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264048379"}]},"ts":"1676264048379"} 2023-02-13 04:54:08,382 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 884e4256c9aa5930bdd891bcf997257a, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:08,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 04:54:08,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:08,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 884e4256c9aa5930bdd891bcf997257a, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:54:08,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:54:08,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:08,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:54:08,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:54:08,539 INFO [StoreOpener-884e4256c9aa5930bdd891bcf997257a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:54:08,540 DEBUG [StoreOpener-884e4256c9aa5930bdd891bcf997257a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1 2023-02-13 04:54:08,540 DEBUG [StoreOpener-884e4256c9aa5930bdd891bcf997257a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1 2023-02-13 04:54:08,541 INFO [StoreOpener-884e4256c9aa5930bdd891bcf997257a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 884e4256c9aa5930bdd891bcf997257a columnFamilyName family1 2023-02-13 04:54:08,542 INFO [StoreOpener-884e4256c9aa5930bdd891bcf997257a-1] regionserver.HStore(310): Store=884e4256c9aa5930bdd891bcf997257a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:08,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:54:08,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:54:08,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:54:08,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:54:08,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 884e4256c9aa5930bdd891bcf997257a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66586761, jitterRate=-0.007779940962791443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:54:08,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 884e4256c9aa5930bdd891bcf997257a: Running coprocessor pre-open hook at 1676264048538Writing region info on filesystem at 1676264048538Initializing all the Stores at 1676264048538Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676264048539 (+1 ms)Cleaning up temporary data from old regions at 1676264048544 (+5 ms)Cleaning up detritus from prior splits at 1676264048544Running coprocessor post-open hooks at 1676264048549 (+5 ms)Region opened successfully at 1676264048549 2023-02-13 04:54:08,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a., pid=25, masterSystemTime=1676264048534 2023-02-13 04:54:08,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:08,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:08,552 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=884e4256c9aa5930bdd891bcf997257a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:08,552 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676264048552"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264048552"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264048552"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264048552"}]},"ts":"1676264048552"} 2023-02-13 04:54:08,555 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-13 04:54:08,555 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 884e4256c9aa5930bdd891bcf997257a, server=jenkins-hbase4.apache.org,37513,1676264019660 in 172 msec 2023-02-13 04:54:08,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-13 04:54:08,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=884e4256c9aa5930bdd891bcf997257a, ASSIGN in 329 msec 2023-02-13 04:54:08,558 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:54:08,558 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264048558"}]},"ts":"1676264048558"} 2023-02-13 04:54:08,559 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 04:54:08,562 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:54:08,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1760 sec 2023-02-13 04:54:09,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 04:54:09,497 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-13 04:54:09,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:09,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:09,526 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:09,526 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:09,526 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:09,526 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:09,526 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:09,526 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:09,528 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:09,528 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:09,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:09,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:09,528 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:09,528 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:09,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:09,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:09,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:09,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:09,529 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:09,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:09,529 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:09,529 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:09,529 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:09,529 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:09,530 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:09,530 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:09,530 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:09,530 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 04:54:09,951 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c04ad58397f84014ad2ea18dbccc88cf to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130c04ad58397f84014ad2ea18dbccc88cf 2023-02-13 04:54:10,355 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/da55809b097449aab88d7b2665bad6fd 2023-02-13 04:54:10,362 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/da55809b097449aab88d7b2665bad6fd as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/da55809b097449aab88d7b2665bad6fd 2023-02-13 04:54:10,366 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/da55809b097449aab88d7b2665bad6fd, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 04:54:10,367 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 837ms, sequenceid=5, compaction requested=false 2023-02-13 04:54:10,368 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:10,390 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:10,390 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:10,390 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:10,390 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:10,390 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:54:10,390 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,390 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:10,390 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6641104d to 127.0.0.1:54862 2023-02-13 04:54:10,390 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:10,390 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:54:10,391 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:54:10,391 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68fddbb0 to 127.0.0.1:54862 2023-02-13 04:54:10,391 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:54:10,391 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:54:10,392 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40b18af3 to 127.0.0.1:54862 2023-02-13 04:54:10,392 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:54:10,394 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,394 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:10,395 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:10,395 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:10,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@418eeb11[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:10,396 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:10,396 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,397 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,397 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:10,397 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:10,398 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:10,398 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,398 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:10,399 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:10,399 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,399 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:10,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:10,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:10,399 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:10,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:10,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:10,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:10,401 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:10,401 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:10,401 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:10,401 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,401 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:10,404 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,404 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:10,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:10,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,404 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:10,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:10,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:10,404 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:10,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:10,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,406 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:10,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,409 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,409 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,409 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:10,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:10,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:10,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:10,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:10,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:10,409 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:10,409 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:10,409 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,409 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:10,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:10,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:10,409 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,409 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:10,409 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,410 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,410 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,510 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:10,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:10,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:10,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:10,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,516 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:10,516 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:10,516 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:10,516 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:10,517 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,517 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,518 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,518 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:10,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:10,518 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:10,518 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:10,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,519 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,519 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:10,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:10,520 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:10,520 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:10,520 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:10,520 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 04:54:10,933 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289279ce44a2a54216a2540b274777af88 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511289279ce44a2a54216a2540b274777af88 2023-02-13 04:54:11,338 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/76d570db20e340acbd70ca7a0fef13b2 2023-02-13 04:54:11,344 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/76d570db20e340acbd70ca7a0fef13b2 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/76d570db20e340acbd70ca7a0fef13b2 2023-02-13 04:54:11,348 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/76d570db20e340acbd70ca7a0fef13b2, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 04:54:11,349 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 829ms, sequenceid=9, compaction requested=false 2023-02-13 04:54:11,349 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:11,349 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:11,349 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:11,349 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:11,349 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,349 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:11,349 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:11,351 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:11,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:11,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f0779a4[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:11,352 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:11,353 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,354 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,354 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:11,354 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:11,354 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:11,354 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,354 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:11,356 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:11,356 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,356 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,356 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:11,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:11,358 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:11,358 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:11,358 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:11,358 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,358 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:11,359 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,359 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,360 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:11,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:11,360 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:11,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,361 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,364 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,364 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:11,364 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:11,364 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:11,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:11,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:11,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:11,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:11,364 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:11,364 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:11,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:11,364 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,365 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,365 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,365 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:11,365 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:11,365 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,465 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:11,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:11,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:11,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:11,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,472 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:11,472 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:11,472 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:11,472 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:11,473 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,473 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,474 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:11,474 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:11,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:11,474 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:11,474 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:11,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,475 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:11,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:11,475 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:11,475 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:11,475 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:11,476 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:11,476 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:11,476 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:11,476 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:11,476 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:11,891 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b0220192e1854bb9815dac766edeae19 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201b0220192e1854bb9815dac766edeae19 2023-02-13 04:54:12,298 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/6a9cb07c68784429b297ed55db68bce3 2023-02-13 04:54:12,304 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/6a9cb07c68784429b297ed55db68bce3 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6a9cb07c68784429b297ed55db68bce3 2023-02-13 04:54:12,309 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6a9cb07c68784429b297ed55db68bce3, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 04:54:12,310 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 834ms, sequenceid=13, compaction requested=true 2023-02-13 04:54:12,310 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:12,310 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:12,310 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:12,310 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:12,310 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,310 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:12,310 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:12,313 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,313 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:12,313 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,313 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:12,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:12,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:12,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c96ea4e[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:12,315 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:12,315 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,316 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,316 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:12,316 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:12,316 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,316 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:12,316 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:12,317 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:12,317 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:12,317 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,317 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:12,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:12,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:12,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:12,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:12,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:12,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:12,320 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:12,320 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:12,320 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:12,320 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,320 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:12,325 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,325 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:12,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,325 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:12,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:12,325 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,326 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,329 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,329 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,329 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,329 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,329 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,329 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,329 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:12,329 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:12,329 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:12,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:12,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:12,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:12,329 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:12,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:12,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:12,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:12,330 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:12,330 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:12,430 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:12,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:12,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:12,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:12,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,438 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:12,438 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:12,438 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:12,438 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:12,438 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,438 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,439 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,440 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:12,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:12,440 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,440 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:12,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:12,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,441 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,442 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:12,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,442 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:12,442 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:12,442 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:12,442 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:12,442 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:12,442 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:12,442 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:12,442 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:12,458 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205bdfaf4668445410e85a035e538e5db6f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205bdfaf4668445410e85a035e538e5db6f 2023-02-13 04:54:12,864 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/7e578406e85042f7b01996cb8601e928 2023-02-13 04:54:12,870 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/7e578406e85042f7b01996cb8601e928 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/7e578406e85042f7b01996cb8601e928 2023-02-13 04:54:12,874 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/7e578406e85042f7b01996cb8601e928, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 04:54:12,875 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 433ms, sequenceid=17, compaction requested=true 2023-02-13 04:54:12,875 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:12,875 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:12,875 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:12,875 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:12,877 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,877 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:12,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:12,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:12,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:12,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:12,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:12,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ec7e7ce[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:12,879 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:12,879 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,881 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,881 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:12,882 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,882 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:12,883 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:12,886 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:12,886 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:12,886 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:12,886 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,886 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:12,888 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,888 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,888 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:12,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:12,888 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:12,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,889 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:12,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,891 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,891 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:12,891 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:12,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:12,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:12,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:12,891 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:12,891 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:12,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:12,892 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,892 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:12,892 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:12,892 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:12,892 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,892 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,892 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:12,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:12,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:12,992 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:12,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:12,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:13,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:13,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,002 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:13,002 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:13,002 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:13,002 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:13,002 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,002 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,005 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,005 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:13,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:13,005 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,005 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:13,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:13,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,006 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,006 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:13,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:13,006 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:13,007 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:13,007 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:13,007 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:13,007 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:13,422 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283bbe6d50b3d142d188646cdc96ffb0fc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283bbe6d50b3d142d188646cdc96ffb0fc 2023-02-13 04:54:13,828 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/f72b3539b0e145ebb88ec54bfb478595 2023-02-13 04:54:13,835 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/f72b3539b0e145ebb88ec54bfb478595 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/f72b3539b0e145ebb88ec54bfb478595 2023-02-13 04:54:13,840 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/f72b3539b0e145ebb88ec54bfb478595, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 04:54:13,841 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 834ms, sequenceid=21, compaction requested=true 2023-02-13 04:54:13,841 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:13,841 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:13,841 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:13,841 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:13,841 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,841 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:13,841 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:13,843 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,843 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:13,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:13,844 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,844 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:13,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:13,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:13,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:13,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:13,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38a74364[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:13,846 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:13,846 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,847 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,847 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:13,847 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:13,847 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:13,847 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,847 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:13,849 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:13,849 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:13,849 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,849 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:13,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:13,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:13,852 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:13,852 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:13,852 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:13,852 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,852 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:13,854 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,854 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,854 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:13,855 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:13,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,856 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,858 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,858 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,858 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:13,858 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:13,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:13,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:13,858 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:13,858 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:13,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:13,859 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,859 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,859 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,859 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:13,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:13,859 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,859 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:13,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:13,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:13,959 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:13,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:13,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:13,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:13,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,967 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:13,967 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:13,968 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:13,968 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:13,968 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,968 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,969 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,969 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:13,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:13,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:13,970 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:13,970 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:13,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,971 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,971 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:13,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:13,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:13,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:13,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:13,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:13,971 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:13,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:13,971 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:13,972 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:14,075 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:54:14,387 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123199e39602fb91423a8725c2d5c31ed117 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123199e39602fb91423a8725c2d5c31ed117 2023-02-13 04:54:14,397 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/19ed9405a0a54100872a8644cd8ce95b 2023-02-13 04:54:14,402 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/19ed9405a0a54100872a8644cd8ce95b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/19ed9405a0a54100872a8644cd8ce95b 2023-02-13 04:54:14,407 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/19ed9405a0a54100872a8644cd8ce95b, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 04:54:14,408 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 436ms, sequenceid=25, compaction requested=true 2023-02-13 04:54:14,408 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:14,408 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:14,408 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:14,409 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:14,409 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,409 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:14,409 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:14,410 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,410 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:14,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:14,411 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,411 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:14,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:14,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:14,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:14,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:14,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cb9d78d[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:14,413 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:14,413 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,415 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,415 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:14,415 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:14,415 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,415 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:14,415 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:14,422 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:14,422 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,422 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:14,422 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:14,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:14,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:14,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:14,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:14,425 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:14,425 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:14,425 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:14,425 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,425 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:14,426 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,426 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:14,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,427 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:14,427 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:14,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,428 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:14,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:14,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:14,432 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:14,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,432 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:14,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:14,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:14,432 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:14,432 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:14,432 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:14,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:14,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:14,532 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:14,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:14,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:14,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:14,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,540 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:14,540 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:14,540 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:14,540 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:14,541 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,541 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,542 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:14,542 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:14,542 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,543 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:14,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:14,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:14,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:14,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:14,544 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:14,544 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:14,544 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:14,565 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010109ff2f846849403e9f3ad85e11ca732b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010109ff2f846849403e9f3ad85e11ca732b 2023-02-13 04:54:14,972 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/ea78f9b5bc8a49fba08e5622b78c5552 2023-02-13 04:54:14,977 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/ea78f9b5bc8a49fba08e5622b78c5552 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ea78f9b5bc8a49fba08e5622b78c5552 2023-02-13 04:54:14,982 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ea78f9b5bc8a49fba08e5622b78c5552, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 04:54:14,983 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 439ms, sequenceid=29, compaction requested=true 2023-02-13 04:54:14,983 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:14,983 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:14,983 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:14,983 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:14,983 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,983 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:14,983 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:14,984 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,984 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:14,985 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,985 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:14,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:14,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:14,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79694ce[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:14,986 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:14,986 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,987 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,988 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:14,988 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:14,988 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:14,988 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,988 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:14,990 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,990 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:14,990 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:14,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:14,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:14,990 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:14,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:14,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:14,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:14,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:14,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:14,993 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:14,993 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:14,993 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:14,993 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,993 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:14,994 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,994 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:14,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:14,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,994 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:14,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:14,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:14,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:14,995 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:14,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,996 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:14,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,998 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,998 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:14,998 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:14,998 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:14,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:14,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:14,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:14,998 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,998 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:14,998 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:14,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:14,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:14,998 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,999 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:14,999 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:14,999 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:14,999 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,099 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:15,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:15,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:15,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:15,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,106 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:15,106 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:15,106 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:15,106 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:15,106 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,106 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,108 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:15,108 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:15,108 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,108 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:15,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:15,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,109 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,109 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:15,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,109 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:15,109 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:15,109 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:15,109 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:15,109 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:15,109 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:15,109 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:15,109 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:15,522 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103eb7dd143bbce40e08b2deab5ef88b77d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103eb7dd143bbce40e08b2deab5ef88b77d 2023-02-13 04:54:15,928 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/c7e416620eee45dfb7b6126636f08c6a 2023-02-13 04:54:15,933 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/c7e416620eee45dfb7b6126636f08c6a as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/c7e416620eee45dfb7b6126636f08c6a 2023-02-13 04:54:15,938 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/c7e416620eee45dfb7b6126636f08c6a, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 04:54:15,938 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 829ms, sequenceid=33, compaction requested=true 2023-02-13 04:54:15,939 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:15,939 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:15,939 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:15,940 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,940 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:15,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,941 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:15,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:15,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36defa65[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:15,942 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:15,942 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,943 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,943 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:15,943 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:15,943 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:15,943 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,943 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:15,944 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,944 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:15,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,944 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:15,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:15,945 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:15,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:15,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:15,946 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:15,947 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:15,947 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:15,947 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,947 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:15,949 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,949 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:15,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,949 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:15,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:15,949 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,951 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,952 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:15,953 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:15,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:15,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:15,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:15,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:15,953 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:15,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:16,054 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:16,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:16,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:16,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:16,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,060 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:16,060 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:16,060 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:16,060 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:16,060 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,060 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,062 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,062 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:16,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:16,062 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,062 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:16,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:16,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,063 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:16,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,063 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:16,063 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:16,063 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:16,063 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:16,063 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:16,063 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:16,063 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:16,063 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:16,477 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070014f25f0b1a47beb92011e323de2723 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509070014f25f0b1a47beb92011e323de2723 2023-02-13 04:54:16,882 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/1132cd19e0c5480ea5f5f6a69792f68a 2023-02-13 04:54:16,887 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/1132cd19e0c5480ea5f5f6a69792f68a as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/1132cd19e0c5480ea5f5f6a69792f68a 2023-02-13 04:54:16,891 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/1132cd19e0c5480ea5f5f6a69792f68a, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 04:54:16,892 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 829ms, sequenceid=37, compaction requested=true 2023-02-13 04:54:16,892 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:16,892 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:16,892 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:16,892 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:16,892 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,893 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:16,893 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:16,894 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,894 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:16,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:16,894 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,895 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:16,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:16,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:16,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:16,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:16,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@346033b9[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:16,896 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:16,896 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,901 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,901 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:16,901 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:16,901 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:16,901 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,901 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:16,902 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,902 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,903 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:16,903 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:16,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:16,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:16,905 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:16,905 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:16,905 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:16,905 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,905 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:16,906 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,906 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:16,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:16,906 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:16,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:16,907 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,908 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,910 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:16,910 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:16,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:16,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:16,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:16,910 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:16,910 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:16,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:16,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:16,910 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:16,911 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:16,910 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,911 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,911 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:16,911 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,911 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:16,911 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,011 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:17,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:17,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:17,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:17,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,017 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:17,017 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:17,017 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:17,017 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:17,018 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,018 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,020 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,020 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:17,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:17,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:17,021 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,021 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:17,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,021 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:17,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,022 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:17,022 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:17,022 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:17,022 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:17,022 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:17,022 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:17,022 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. started... 2023-02-13 04:54:17,022 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 884e4256c9aa5930bdd891bcf997257a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:17,435 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c12da1204d29408cad12785a3a6c8c9e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120c12da1204d29408cad12785a3a6c8c9e 2023-02-13 04:54:17,841 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/6280064a3e904c3f8805ebaf299239aa 2023-02-13 04:54:17,846 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/6280064a3e904c3f8805ebaf299239aa as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6280064a3e904c3f8805ebaf299239aa 2023-02-13 04:54:17,850 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6280064a3e904c3f8805ebaf299239aa, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 04:54:17,851 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 884e4256c9aa5930bdd891bcf997257a in 829ms, sequenceid=41, compaction requested=true 2023-02-13 04:54:17,851 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:17,851 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:17,851 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:17,851 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:17,851 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,852 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:17,852 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:17,853 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,853 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:17,854 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,854 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:17,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:17,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16479f07[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:17,857 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:17,857 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,858 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,858 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:17,858 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:17,858 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:17,858 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,859 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:17,860 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:17,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:17,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:17,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:17,862 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:17,863 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:17,863 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:17,863 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,863 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:17,866 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,866 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:17,866 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:17,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:17,866 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:17,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,867 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:17,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,869 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,869 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:17,869 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:17,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 04:54:17,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:17,869 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,869 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:17,869 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:17,870 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:17,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:17,870 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:17,870 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,870 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:17,870 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:17,870 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:17,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:17,970 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:17,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:17,972 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-13 04:54:17,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:54:17,975 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:54:17,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:17,976 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264657976 2023-02-13 04:54:17,977 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 04:54:17,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 04:54:17,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:17,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x60833c61 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:54:17,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c14238c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:54:17,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:18,822 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103723bf782ab0a4af68806ea8c4bca5c65 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103723bf782ab0a4af68806ea8c4bca5c65 2023-02-13 04:54:18,823 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:18,836 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:54:18,837 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:54:18,844 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:54:18,845 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49696, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:54:18,854 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2a54a145491d4c2e9d89f5cbe99f14c7 first=Optional[r3] last=Optional[r6] 2023-02-13 04:54:18,855 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2a54a145491d4c2e9d89f5cbe99f14c7}] 2023-02-13 04:54:18,859 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2a54a145491d4c2e9d89f5cbe99f14c7 for inclusion in 884e4256c9aa5930bdd891bcf997257a/family1 2023-02-13 04:54:18,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 04:54:18,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:18,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:18,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2a54a145491d4c2e9d89f5cbe99f14c7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fhets99g790h399pjb057bieet1oq8ls5v9tj84mut9ibnvtrvam5u5ug7kn5ju2/family1/2a54a145491d4c2e9d89f5cbe99f14c7 2023-02-13 04:54:18,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fhets99g790h399pjb057bieet1oq8ls5v9tj84mut9ibnvtrvam5u5ug7kn5ju2/family1/2a54a145491d4c2e9d89f5cbe99f14c7 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/8903cfafe935442e94155e9c90018c52_SeqId_44_ 2023-02-13 04:54:18,867 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fhets99g790h399pjb057bieet1oq8ls5v9tj84mut9ibnvtrvam5u5ug7kn5ju2/family1/2a54a145491d4c2e9d89f5cbe99f14c7 into 884e4256c9aa5930bdd891bcf997257a/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/8903cfafe935442e94155e9c90018c52_SeqId_44_ - updating store file list. 2023-02-13 04:54:18,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/8903cfafe935442e94155e9c90018c52_SeqId_44_ into 884e4256c9aa5930bdd891bcf997257a/family1 2023-02-13 04:54:18,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fhets99g790h399pjb057bieet1oq8ls5v9tj84mut9ibnvtrvam5u5ug7kn5ju2/family1/2a54a145491d4c2e9d89f5cbe99f14c7 into 884e4256c9aa5930bdd891bcf997257a/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/8903cfafe935442e94155e9c90018c52_SeqId_44_) 2023-02-13 04:54:18,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fhets99g790h399pjb057bieet1oq8ls5v9tj84mut9ibnvtrvam5u5ug7kn5ju2/family1/2a54a145491d4c2e9d89f5cbe99f14c7 2023-02-13 04:54:18,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 04:54:18,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 04:54:18,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): 884e4256c9aa5930bdd891bcf997257a/family1 is initiating minor compaction 2023-02-13 04:54:18,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@9c1edfd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:18,876 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 884e4256c9aa5930bdd891bcf997257a/family1 in testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:18,876 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/76d570db20e340acbd70ca7a0fef13b2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6a9cb07c68784429b297ed55db68bce3, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/7e578406e85042f7b01996cb8601e928, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/f72b3539b0e145ebb88ec54bfb478595, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/19ed9405a0a54100872a8644cd8ce95b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ea78f9b5bc8a49fba08e5622b78c5552, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/c7e416620eee45dfb7b6126636f08c6a, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/1132cd19e0c5480ea5f5f6a69792f68a, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6280064a3e904c3f8805ebaf299239aa, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/8903cfafe935442e94155e9c90018c52_SeqId_44_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp, totalSize=50.0 K 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 76d570db20e340acbd70ca7a0fef13b2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 6a9cb07c68784429b297ed55db68bce3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 7e578406e85042f7b01996cb8601e928, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting f72b3539b0e145ebb88ec54bfb478595, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 19ed9405a0a54100872a8644cd8ce95b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting ea78f9b5bc8a49fba08e5622b78c5552, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting c7e416620eee45dfb7b6126636f08c6a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 1132cd19e0c5480ea5f5f6a69792f68a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 6280064a3e904c3f8805ebaf299239aa, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 04:54:18,877 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 8903cfafe935442e94155e9c90018c52_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 04:54:18,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:18,880 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:18,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283bbe6d50b3d142d188646cdc96ffb0fc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283bbe6d50b3d142d188646cdc96ffb0fc 2023-02-13 04:54:18,883 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123199e39602fb91423a8725c2d5c31ed117 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123199e39602fb91423a8725c2d5c31ed117 2023-02-13 04:54:18,885 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010109ff2f846849403e9f3ad85e11ca732b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010109ff2f846849403e9f3ad85e11ca732b 2023-02-13 04:54:18,886 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103eb7dd143bbce40e08b2deab5ef88b77d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103eb7dd143bbce40e08b2deab5ef88b77d 2023-02-13 04:54:18,886 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 04:54:18,886 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 04:54:18,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:18,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:18,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:18,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:18,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:18,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:18,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:18,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:18,905 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 884e4256c9aa5930bdd891bcf997257a#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:54:19,322 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120516636e95a1624e4eb43f7b41fd9096f0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120516636e95a1624e4eb43f7b41fd9096f0 2023-02-13 04:54:19,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:19,324 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/2b2776926c324dc9ac5c7126a565c640 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/2b2776926c324dc9ac5c7126a565c640 2023-02-13 04:54:19,331 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 884e4256c9aa5930bdd891bcf997257a/family1 of 884e4256c9aa5930bdd891bcf997257a into 2b2776926c324dc9ac5c7126a565c640(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:54:19,331 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:19,331 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676264058876; duration=0sec 2023-02-13 04:54:19,331 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:19,353 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fa30e3b9cf7b4e859a5a1dd9c17f7eea first=Optional[r1] last=Optional[r2] 2023-02-13 04:54:19,353 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fa30e3b9cf7b4e859a5a1dd9c17f7eea}] 2023-02-13 04:54:19,357 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fa30e3b9cf7b4e859a5a1dd9c17f7eea for inclusion in 884e4256c9aa5930bdd891bcf997257a/family1 2023-02-13 04:54:19,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 04:54:19,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:19,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:19,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/fa30e3b9cf7b4e859a5a1dd9c17f7eea to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rbap5gbpij8njlub4o8c3brfa4vjjombmvkgd4ls8vc3hd591slsim9tg6lc33tr/family1/fa30e3b9cf7b4e859a5a1dd9c17f7eea 2023-02-13 04:54:19,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rbap5gbpij8njlub4o8c3brfa4vjjombmvkgd4ls8vc3hd591slsim9tg6lc33tr/family1/fa30e3b9cf7b4e859a5a1dd9c17f7eea as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ffcde283422e42308ac47f3750e61636_SeqId_47_ 2023-02-13 04:54:19,363 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rbap5gbpij8njlub4o8c3brfa4vjjombmvkgd4ls8vc3hd591slsim9tg6lc33tr/family1/fa30e3b9cf7b4e859a5a1dd9c17f7eea into 884e4256c9aa5930bdd891bcf997257a/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ffcde283422e42308ac47f3750e61636_SeqId_47_ - updating store file list. 2023-02-13 04:54:19,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ffcde283422e42308ac47f3750e61636_SeqId_47_ into 884e4256c9aa5930bdd891bcf997257a/family1 2023-02-13 04:54:19,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rbap5gbpij8njlub4o8c3brfa4vjjombmvkgd4ls8vc3hd591slsim9tg6lc33tr/family1/fa30e3b9cf7b4e859a5a1dd9c17f7eea into 884e4256c9aa5930bdd891bcf997257a/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ffcde283422e42308ac47f3750e61636_SeqId_47_) 2023-02-13 04:54:19,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rbap5gbpij8njlub4o8c3brfa4vjjombmvkgd4ls8vc3hd591slsim9tg6lc33tr/family1/fa30e3b9cf7b4e859a5a1dd9c17f7eea 2023-02-13 04:54:19,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 04:54:19,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 04:54:19,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): 884e4256c9aa5930bdd891bcf997257a/family1 is initiating minor compaction (all files) 2023-02-13 04:54:19,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@18fed3e2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:19,369 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 884e4256c9aa5930bdd891bcf997257a/family1 in testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:54:19,369 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/da55809b097449aab88d7b2665bad6fd, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/2b2776926c324dc9ac5c7126a565c640, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ffcde283422e42308ac47f3750e61636_SeqId_47_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp, totalSize=176.8 K 2023-02-13 04:54:19,369 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting da55809b097449aab88d7b2665bad6fd, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843565 2023-02-13 04:54:19,370 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 2b2776926c324dc9ac5c7126a565c640, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243565 2023-02-13 04:54:19,370 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting ffcde283422e42308ac47f3750e61636_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965243565 2023-02-13 04:54:19,370 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:19,371 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:19,373 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201b0220192e1854bb9815dac766edeae19 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201b0220192e1854bb9815dac766edeae19 2023-02-13 04:54:19,375 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205bdfaf4668445410e85a035e538e5db6f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205bdfaf4668445410e85a035e538e5db6f 2023-02-13 04:54:19,375 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-13 04:54:19,375 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 04:54:19,375 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:19,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:19,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:19,377 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:54:19,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4040 sec 2023-02-13 04:54:19,388 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 884e4256c9aa5930bdd891bcf997257a#family1#compaction#35 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:54:19,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/76d570db20e340acbd70ca7a0fef13b2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6a9cb07c68784429b297ed55db68bce3, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/7e578406e85042f7b01996cb8601e928, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/f72b3539b0e145ebb88ec54bfb478595, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/19ed9405a0a54100872a8644cd8ce95b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ea78f9b5bc8a49fba08e5622b78c5552, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/c7e416620eee45dfb7b6126636f08c6a, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/1132cd19e0c5480ea5f5f6a69792f68a, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6280064a3e904c3f8805ebaf299239aa, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/8903cfafe935442e94155e9c90018c52_SeqId_44_] to archive 2023-02-13 04:54:19,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:19,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/76d570db20e340acbd70ca7a0fef13b2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/76d570db20e340acbd70ca7a0fef13b2 2023-02-13 04:54:19,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6a9cb07c68784429b297ed55db68bce3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6a9cb07c68784429b297ed55db68bce3 2023-02-13 04:54:19,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/7e578406e85042f7b01996cb8601e928 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/7e578406e85042f7b01996cb8601e928 2023-02-13 04:54:19,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/f72b3539b0e145ebb88ec54bfb478595 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/f72b3539b0e145ebb88ec54bfb478595 2023-02-13 04:54:19,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/19ed9405a0a54100872a8644cd8ce95b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/19ed9405a0a54100872a8644cd8ce95b 2023-02-13 04:54:19,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ea78f9b5bc8a49fba08e5622b78c5552 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ea78f9b5bc8a49fba08e5622b78c5552 2023-02-13 04:54:19,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/c7e416620eee45dfb7b6126636f08c6a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/c7e416620eee45dfb7b6126636f08c6a 2023-02-13 04:54:19,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/1132cd19e0c5480ea5f5f6a69792f68a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/1132cd19e0c5480ea5f5f6a69792f68a 2023-02-13 04:54:19,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6280064a3e904c3f8805ebaf299239aa to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/6280064a3e904c3f8805ebaf299239aa 2023-02-13 04:54:19,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/8903cfafe935442e94155e9c90018c52_SeqId_44_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/8903cfafe935442e94155e9c90018c52_SeqId_44_ 2023-02-13 04:54:19,471 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=252 (was 252), OpenFileDescriptor=596 (was 611), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 273), ProcessCount=168 (was 168), AvailableMemoryMB=4421 (was 4491) 2023-02-13 04:54:19,485 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=252, OpenFileDescriptor=596, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=168, AvailableMemoryMB=4421 2023-02-13 04:54:19,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 04:54:19,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:19,490 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:54:19,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-13 04:54:19,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 04:54:19,491 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:54:19,493 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:19,493 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:19,494 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:19,494 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5 empty. 2023-02-13 04:54:19,494 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f empty. 2023-02-13 04:54:19,494 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb empty. 2023-02-13 04:54:19,495 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:19,495 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:19,495 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:19,495 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-13 04:54:19,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 04:54:19,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 04:54:19,908 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-13 04:54:19,909 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => c2a39fa957db2c535903d705efd223f5, NAME => 'testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:54:19,910 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => e1fe4f9b4d232b0b98c8aa4a897a443f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:54:19,910 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => e994b917f8df7b3d815819b2163f57fb, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:54:20,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 04:54:20,324 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:20,324 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing c2a39fa957db2c535903d705efd223f5, disabling compactions & flushes 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing e1fe4f9b4d232b0b98c8aa4a897a443f, disabling compactions & flushes 2023-02-13 04:54:20,325 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. after waiting 0 ms 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:20,325 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:20,325 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for c2a39fa957db2c535903d705efd223f5: Waiting for close lock at 1676264060325Disabling compacts and flushes for region at 1676264060325Disabling writes for close at 1676264060325Writing region close event to WAL at 1676264060325Closed at 1676264060325 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. after waiting 0 ms 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:20,325 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:20,325 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for e1fe4f9b4d232b0b98c8aa4a897a443f: Waiting for close lock at 1676264060325Disabling compacts and flushes for region at 1676264060325Disabling writes for close at 1676264060325Writing region close event to WAL at 1676264060325Closed at 1676264060325 2023-02-13 04:54:20,330 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:20,330 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing e994b917f8df7b3d815819b2163f57fb, disabling compactions & flushes 2023-02-13 04:54:20,330 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:20,330 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:20,330 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. after waiting 0 ms 2023-02-13 04:54:20,330 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:20,330 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:20,330 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for e994b917f8df7b3d815819b2163f57fb: Waiting for close lock at 1676264060330Disabling compacts and flushes for region at 1676264060330Disabling writes for close at 1676264060330Writing region close event to WAL at 1676264060330Closed at 1676264060330 2023-02-13 04:54:20,333 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:54:20,334 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676264060333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264060333"}]},"ts":"1676264060333"} 2023-02-13 04:54:20,334 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676264060333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264060333"}]},"ts":"1676264060333"} 2023-02-13 04:54:20,334 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676264060333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264060333"}]},"ts":"1676264060333"} 2023-02-13 04:54:20,336 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 04:54:20,337 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:54:20,337 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264060337"}]},"ts":"1676264060337"} 2023-02-13 04:54:20,339 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-13 04:54:20,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c2a39fa957db2c535903d705efd223f5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e1fe4f9b4d232b0b98c8aa4a897a443f, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e994b917f8df7b3d815819b2163f57fb, ASSIGN}] 2023-02-13 04:54:20,349 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e1fe4f9b4d232b0b98c8aa4a897a443f, ASSIGN 2023-02-13 04:54:20,349 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e994b917f8df7b3d815819b2163f57fb, ASSIGN 2023-02-13 04:54:20,349 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c2a39fa957db2c535903d705efd223f5, ASSIGN 2023-02-13 04:54:20,350 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e1fe4f9b4d232b0b98c8aa4a897a443f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:54:20,350 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e994b917f8df7b3d815819b2163f57fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:54:20,350 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c2a39fa957db2c535903d705efd223f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:54:20,501 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e1fe4f9b4d232b0b98c8aa4a897a443f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:20,501 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=e994b917f8df7b3d815819b2163f57fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:20,501 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c2a39fa957db2c535903d705efd223f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:20,502 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676264060501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264060501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264060501"}]},"ts":"1676264060501"} 2023-02-13 04:54:20,502 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676264060501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264060501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264060501"}]},"ts":"1676264060501"} 2023-02-13 04:54:20,502 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676264060501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264060501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264060501"}]},"ts":"1676264060501"} 2023-02-13 04:54:20,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure e1fe4f9b4d232b0b98c8aa4a897a443f, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:20,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure c2a39fa957db2c535903d705efd223f5, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:20,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure e994b917f8df7b3d815819b2163f57fb, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:20,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 04:54:20,616 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/.tmp/family1/dbd6f460b0db416aa42644cf2c9f5ced as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/dbd6f460b0db416aa42644cf2c9f5ced 2023-02-13 04:54:20,621 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 884e4256c9aa5930bdd891bcf997257a/family1 of 884e4256c9aa5930bdd891bcf997257a into dbd6f460b0db416aa42644cf2c9f5ced(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:54:20,621 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 884e4256c9aa5930bdd891bcf997257a: 2023-02-13 04:54:20,621 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676264059368; duration=1sec 2023-02-13 04:54:20,622 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:20,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/da55809b097449aab88d7b2665bad6fd, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/2b2776926c324dc9ac5c7126a565c640, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ffcde283422e42308ac47f3750e61636_SeqId_47_] to archive 2023-02-13 04:54:20,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:20,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/da55809b097449aab88d7b2665bad6fd to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/da55809b097449aab88d7b2665bad6fd 2023-02-13 04:54:20,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/2b2776926c324dc9ac5c7126a565c640 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/2b2776926c324dc9ac5c7126a565c640 2023-02-13 04:54:20,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ffcde283422e42308ac47f3750e61636_SeqId_47_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/family1/ffcde283422e42308ac47f3750e61636_SeqId_47_ 2023-02-13 04:54:20,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:20,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c2a39fa957db2c535903d705efd223f5, NAME => 'testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 04:54:20,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:20,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:20,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:20,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:20,660 INFO [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:20,661 DEBUG [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5/family1 2023-02-13 04:54:20,661 DEBUG [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5/family1 2023-02-13 04:54:20,662 INFO [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2a39fa957db2c535903d705efd223f5 columnFamilyName family1 2023-02-13 04:54:20,663 INFO [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] regionserver.HStore(310): Store=c2a39fa957db2c535903d705efd223f5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:20,663 INFO [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:20,665 DEBUG [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5/family2 2023-02-13 04:54:20,665 DEBUG [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5/family2 2023-02-13 04:54:20,665 INFO [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2a39fa957db2c535903d705efd223f5 columnFamilyName family2 2023-02-13 04:54:20,666 INFO [StoreOpener-c2a39fa957db2c535903d705efd223f5-1] regionserver.HStore(310): Store=c2a39fa957db2c535903d705efd223f5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:20,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:20,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:20,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:54:20,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c2a39fa957db2c535903d705efd223f5 2023-02-13 04:54:20,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:54:20,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c2a39fa957db2c535903d705efd223f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64478948, jitterRate=-0.03918880224227905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:54:20,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c2a39fa957db2c535903d705efd223f5: Running coprocessor pre-open hook at 1676264060659Writing region info on filesystem at 1676264060659Initializing all the Stores at 1676264060660 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264060660Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264060660Cleaning up temporary data from old regions at 1676264060668 (+8 ms)Cleaning up detritus from prior splits at 1676264060669 (+1 ms)Running coprocessor post-open hooks at 1676264060673 (+4 ms)Region opened successfully at 1676264060673 2023-02-13 04:54:20,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5., pid=32, masterSystemTime=1676264060656 2023-02-13 04:54:20,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:20,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:20,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:20,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e994b917f8df7b3d815819b2163f57fb, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 04:54:20,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:20,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:20,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:20,677 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c2a39fa957db2c535903d705efd223f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:20,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:20,677 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676264060677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264060677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264060677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264060677"}]},"ts":"1676264060677"} 2023-02-13 04:54:20,678 INFO [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:20,680 DEBUG [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1 2023-02-13 04:54:20,680 DEBUG [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1 2023-02-13 04:54:20,680 INFO [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e994b917f8df7b3d815819b2163f57fb columnFamilyName family1 2023-02-13 04:54:20,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-02-13 04:54:20,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure c2a39fa957db2c535903d705efd223f5, server=jenkins-hbase4.apache.org,37513,1676264019660 in 174 msec 2023-02-13 04:54:20,681 INFO [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] regionserver.HStore(310): Store=e994b917f8df7b3d815819b2163f57fb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:20,681 INFO [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:20,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c2a39fa957db2c535903d705efd223f5, ASSIGN in 334 msec 2023-02-13 04:54:20,683 DEBUG [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family2 2023-02-13 04:54:20,683 DEBUG [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family2 2023-02-13 04:54:20,684 INFO [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e994b917f8df7b3d815819b2163f57fb columnFamilyName family2 2023-02-13 04:54:20,685 INFO [StoreOpener-e994b917f8df7b3d815819b2163f57fb-1] regionserver.HStore(310): Store=e994b917f8df7b3d815819b2163f57fb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:20,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:20,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:20,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:54:20,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:54:20,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:54:20,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e994b917f8df7b3d815819b2163f57fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73881839, jitterRate=0.10092519223690033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:54:20,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e994b917f8df7b3d815819b2163f57fb: Running coprocessor pre-open hook at 1676264060677Writing region info on filesystem at 1676264060677Initializing all the Stores at 1676264060678 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264060678Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264060678Cleaning up temporary data from old regions at 1676264060687 (+9 ms)Cleaning up detritus from prior splits at 1676264060687Running coprocessor post-open hooks at 1676264060690 (+3 ms)Region opened successfully at 1676264060690 2023-02-13 04:54:20,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb., pid=33, masterSystemTime=1676264060656 2023-02-13 04:54:20,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:20,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:20,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:20,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e1fe4f9b4d232b0b98c8aa4a897a443f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 04:54:20,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:20,693 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=e994b917f8df7b3d815819b2163f57fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:20,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:20,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:20,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:20,693 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676264060693"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264060693"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264060693"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264060693"}]},"ts":"1676264060693"} 2023-02-13 04:54:20,694 INFO [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:20,695 DEBUG [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f/family1 2023-02-13 04:54:20,696 DEBUG [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f/family1 2023-02-13 04:54:20,696 INFO [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1fe4f9b4d232b0b98c8aa4a897a443f columnFamilyName family1 2023-02-13 04:54:20,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-02-13 04:54:20,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure e994b917f8df7b3d815819b2163f57fb, server=jenkins-hbase4.apache.org,37513,1676264019660 in 190 msec 2023-02-13 04:54:20,697 INFO [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] regionserver.HStore(310): Store=e1fe4f9b4d232b0b98c8aa4a897a443f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:20,697 INFO [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:20,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e994b917f8df7b3d815819b2163f57fb, ASSIGN in 349 msec 2023-02-13 04:54:20,698 DEBUG [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f/family2 2023-02-13 04:54:20,698 DEBUG [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f/family2 2023-02-13 04:54:20,699 INFO [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1fe4f9b4d232b0b98c8aa4a897a443f columnFamilyName family2 2023-02-13 04:54:20,699 INFO [StoreOpener-e1fe4f9b4d232b0b98c8aa4a897a443f-1] regionserver.HStore(310): Store=e1fe4f9b4d232b0b98c8aa4a897a443f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:20,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:20,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:20,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:54:20,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:54:20,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:54:20,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e1fe4f9b4d232b0b98c8aa4a897a443f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60487944, jitterRate=-0.09865939617156982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:54:20,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e1fe4f9b4d232b0b98c8aa4a897a443f: Running coprocessor pre-open hook at 1676264060693Writing region info on filesystem at 1676264060693Initializing all the Stores at 1676264060694 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264060694Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264060694Cleaning up temporary data from old regions at 1676264060701 (+7 ms)Cleaning up detritus from prior splits at 1676264060701Running coprocessor post-open hooks at 1676264060705 (+4 ms)Region opened successfully at 1676264060705 2023-02-13 04:54:20,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f., pid=31, masterSystemTime=1676264060656 2023-02-13 04:54:20,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:20,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:20,707 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e1fe4f9b4d232b0b98c8aa4a897a443f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:20,708 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676264060707"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264060707"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264060707"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264060707"}]},"ts":"1676264060707"} 2023-02-13 04:54:20,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-02-13 04:54:20,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure e1fe4f9b4d232b0b98c8aa4a897a443f, server=jenkins-hbase4.apache.org,37513,1676264019660 in 205 msec 2023-02-13 04:54:20,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-02-13 04:54:20,712 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e1fe4f9b4d232b0b98c8aa4a897a443f, ASSIGN in 363 msec 2023-02-13 04:54:20,713 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:54:20,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264060713"}]},"ts":"1676264060713"} 2023-02-13 04:54:20,714 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-13 04:54:20,716 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:54:20,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2290 sec 2023-02-13 04:54:21,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 04:54:21,597 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-13 04:54:21,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:21,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:21,606 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 04:54:21,606 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:21,606 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 04:54:21,606 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 04:54:21,606 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:21,607 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:21,608 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:21,608 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:21,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:21,608 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:21,608 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:21,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:21,609 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:21,610 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:21,610 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 04:54:21,610 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:21,610 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 04:54:21,611 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:21,611 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:21,611 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. started... 2023-02-13 04:54:21,612 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. started... 2023-02-13 04:54:21,614 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:54:21,614 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e994b917f8df7b3d815819b2163f57fb 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-13 04:54:21,614 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:21,614 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:21,614 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e1fe4f9b4d232b0b98c8aa4a897a443f: 2023-02-13 04:54:21,614 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. started... 2023-02-13 04:54:21,615 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:21,615 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:54:21,615 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c2a39fa957db2c535903d705efd223f5: 2023-02-13 04:54:21,615 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:21,615 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:54:22,029 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213483f98cacec2437ea2f6bb24b564c155 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213483f98cacec2437ea2f6bb24b564c155 2023-02-13 04:54:22,435 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/.tmp/family1/991f8bcf1f874e3abe2ee62846f45cd9 2023-02-13 04:54:22,440 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/.tmp/family1/991f8bcf1f874e3abe2ee62846f45cd9 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/991f8bcf1f874e3abe2ee62846f45cd9 2023-02-13 04:54:22,445 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/991f8bcf1f874e3abe2ee62846f45cd9, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 04:54:22,446 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for e994b917f8df7b3d815819b2163f57fb in 832ms, sequenceid=5, compaction requested=false 2023-02-13 04:54:22,446 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-13 04:54:22,447 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e994b917f8df7b3d815819b2163f57fb: 2023-02-13 04:54:22,447 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:22,447 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:54:22,447 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:54:22,447 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,447 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 04:54:22,447 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 04:54:22,449 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,449 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:22,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:22,449 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,449 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:22,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:22,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:22,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:22,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 04:54:22,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25c459e5[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:22,450 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 04:54:22,450 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,453 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,453 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 04:54:22,453 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 04:54:22,453 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:22,453 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,453 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:22,454 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 04:54:22,455 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,455 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,455 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 04:54:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:22,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 04:54:22,457 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 04:54:22,457 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:22,457 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:22,457 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,457 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:22,458 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,458 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:22,458 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:22,459 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:22,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:22,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:22,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:22,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,460 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:22,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,465 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:22,465 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:22,465 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,465 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,465 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,465 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,465 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,465 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:22,465 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 04:54:22,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:22,465 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:22,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:22,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 04:54:22,466 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:22,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:22,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:22,466 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:22,566 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:22,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:22,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:22,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:22,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,573 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 04:54:22,573 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:22,573 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 04:54:22,573 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 04:54:22,573 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,573 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,575 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:22,575 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:22,575 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:22,575 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:22,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,576 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,576 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-13 04:54:22,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:22,576 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 04:54:22,576 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:22,576 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 04:54:22,576 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:22,577 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. started... 2023-02-13 04:54:22,577 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:22,577 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. started... 2023-02-13 04:54:22,577 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e994b917f8df7b3d815819b2163f57fb 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-13 04:54:22,577 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e1fe4f9b4d232b0b98c8aa4a897a443f: 2023-02-13 04:54:22,577 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:54:22,578 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:54:22,578 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:22,578 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:54:22,578 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:22,578 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. started... 2023-02-13 04:54:22,578 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c2a39fa957db2c535903d705efd223f5: 2023-02-13 04:54:22,578 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:54:22,579 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:54:22,995 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213092d8af9768f4ed0aa4877e153eb6b13 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213092d8af9768f4ed0aa4877e153eb6b13 2023-02-13 04:54:23,400 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/.tmp/family1/ee34cb4cde3243c19b05797b681d2df9 2023-02-13 04:54:23,406 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/.tmp/family1/ee34cb4cde3243c19b05797b681d2df9 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/ee34cb4cde3243c19b05797b681d2df9 2023-02-13 04:54:23,410 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/ee34cb4cde3243c19b05797b681d2df9, entries=2, sequenceid=9, filesize=5.0 K 2023-02-13 04:54:23,411 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for e994b917f8df7b3d815819b2163f57fb in 834ms, sequenceid=9, compaction requested=false 2023-02-13 04:54:23,411 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e994b917f8df7b3d815819b2163f57fb: 2023-02-13 04:54:23,411 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:54:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:54:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 04:54:23,411 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 04:54:23,413 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:23,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:23,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:23,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:23,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 04:54:23,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@648882ea[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:23,415 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 04:54:23,415 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,416 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,416 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 04:54:23,416 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 04:54:23,416 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:23,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:23,423 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,423 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 04:54:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:23,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:23,423 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:23,423 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 04:54:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:23,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 04:54:23,425 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 04:54:23,425 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:23,425 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:23,426 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,426 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:23,427 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,427 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,427 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:23,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:23,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:23,428 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:23,429 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:23,431 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:23,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:23,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:23,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 04:54:23,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:23,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:23,431 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:23,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 04:54:23,432 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:23,432 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:23,432 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:23,432 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:23,432 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,532 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:23,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:23,540 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-13 04:54:23,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 04:54:23,543 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 04:54:23,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:23,543 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264663543 2023-02-13 04:54:23,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:54:23,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-13 04:54:23,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 04:54:23,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x31da6de8 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:54:23,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cdf201c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:54:23,548 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 04:54:24,374 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213d154533e0e034cfcadedc1adfa297983 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213d154533e0e034cfcadedc1adfa297983 2023-02-13 04:54:24,375 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 04:54:24,388 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:54:24,389 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46262, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:54:24,396 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:54:24,398 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42850, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:54:24,406 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/21e314ffd0ad4ceeb7837a1788b0439c first=Optional[k0] last=Optional[k1] 2023-02-13 04:54:24,407 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/21e314ffd0ad4ceeb7837a1788b0439c}] 2023-02-13 04:54:24,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/21e314ffd0ad4ceeb7837a1788b0439c for inclusion in e994b917f8df7b3d815819b2163f57fb/family1 2023-02-13 04:54:24,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-13 04:54:24,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 04:54:24,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for e994b917f8df7b3d815819b2163f57fb: 2023-02-13 04:54:24,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/21e314ffd0ad4ceeb7837a1788b0439c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testScannerOnBulkLoadRefHFiles__8261ev81oaadl68f2k5nghepvl7l7elm34qjrrir0ogbrjbr7un0pfo88c8f7iu9/family1/21e314ffd0ad4ceeb7837a1788b0439c 2023-02-13 04:54:24,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testScannerOnBulkLoadRefHFiles__8261ev81oaadl68f2k5nghepvl7l7elm34qjrrir0ogbrjbr7un0pfo88c8f7iu9/family1/21e314ffd0ad4ceeb7837a1788b0439c as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/cf1e6c14d59949c9872e76b3ec753e1e_SeqId_12_ 2023-02-13 04:54:24,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testScannerOnBulkLoadRefHFiles__8261ev81oaadl68f2k5nghepvl7l7elm34qjrrir0ogbrjbr7un0pfo88c8f7iu9/family1/21e314ffd0ad4ceeb7837a1788b0439c into e994b917f8df7b3d815819b2163f57fb/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/cf1e6c14d59949c9872e76b3ec753e1e_SeqId_12_ - updating store file list. 2023-02-13 04:54:24,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/cf1e6c14d59949c9872e76b3ec753e1e_SeqId_12_ into e994b917f8df7b3d815819b2163f57fb/family1 2023-02-13 04:54:24,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testScannerOnBulkLoadRefHFiles__8261ev81oaadl68f2k5nghepvl7l7elm34qjrrir0ogbrjbr7un0pfo88c8f7iu9/family1/21e314ffd0ad4ceeb7837a1788b0439c into e994b917f8df7b3d815819b2163f57fb/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/cf1e6c14d59949c9872e76b3ec753e1e_SeqId_12_) 2023-02-13 04:54:24,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testScannerOnBulkLoadRefHFiles__8261ev81oaadl68f2k5nghepvl7l7elm34qjrrir0ogbrjbr7un0pfo88c8f7iu9/family1/21e314ffd0ad4ceeb7837a1788b0439c 2023-02-13 04:54:24,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 04:54:24,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 04:54:24,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): e994b917f8df7b3d815819b2163f57fb/family1 is initiating minor compaction (all files) 2023-02-13 04:54:24,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@c02e634; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:24,423 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e994b917f8df7b3d815819b2163f57fb/family1 in testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:54:24,423 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/991f8bcf1f874e3abe2ee62846f45cd9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/ee34cb4cde3243c19b05797b681d2df9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/cf1e6c14d59949c9872e76b3ec753e1e_SeqId_12_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/.tmp, totalSize=15.1 K 2023-02-13 04:54:24,423 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 991f8bcf1f874e3abe2ee62846f45cd9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264061597 2023-02-13 04:54:24,424 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting ee34cb4cde3243c19b05797b681d2df9, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264061597 2023-02-13 04:54:24,424 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting cf1e6c14d59949c9872e76b3ec753e1e_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264061597 2023-02-13 04:54:24,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 04:54:24,425 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:24,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213092d8af9768f4ed0aa4877e153eb6b13 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213092d8af9768f4ed0aa4877e153eb6b13 2023-02-13 04:54:24,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213483f98cacec2437ea2f6bb24b564c155 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213483f98cacec2437ea2f6bb24b564c155 2023-02-13 04:54:24,428 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-13 04:54:24,428 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 04:54:24,429 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 04:54:24,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 04:54:24,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:24,430 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 04:54:24,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 889 msec 2023-02-13 04:54:24,435 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): e994b917f8df7b3d815819b2163f57fb#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:54:24,459 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=251 (was 252), OpenFileDescriptor=604 (was 596) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 239), ProcessCount=168 (was 168), AvailableMemoryMB=4419 (was 4421) 2023-02-13 04:54:24,469 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251, OpenFileDescriptor=604, MaxFileDescriptor=60000, SystemLoadAverage=219, ProcessCount=168, AvailableMemoryMB=4418 2023-02-13 04:54:24,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 04:54:24,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:24,473 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:54:24,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-13 04:54:24,473 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:54:24,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 04:54:24,474 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:54:24,475 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367 empty. 2023-02-13 04:54:24,475 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:54:24,475 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-13 04:54:24,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 04:54:24,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 04:54:24,883 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 04:54:24,884 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 22d440af5bfcfc9939787c5bb9ea8367, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:54:25,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 04:54:25,290 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:25,290 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 22d440af5bfcfc9939787c5bb9ea8367, disabling compactions & flushes 2023-02-13 04:54:25,290 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:25,290 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:25,290 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. after waiting 0 ms 2023-02-13 04:54:25,290 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:25,290 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:25,290 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 22d440af5bfcfc9939787c5bb9ea8367: Waiting for close lock at 1676264065290Disabling compacts and flushes for region at 1676264065290Disabling writes for close at 1676264065290Writing region close event to WAL at 1676264065290Closed at 1676264065290 2023-02-13 04:54:25,293 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:54:25,293 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676264065293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264065293"}]},"ts":"1676264065293"} 2023-02-13 04:54:25,295 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:54:25,296 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:54:25,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264065296"}]},"ts":"1676264065296"} 2023-02-13 04:54:25,297 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 04:54:25,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=22d440af5bfcfc9939787c5bb9ea8367, ASSIGN}] 2023-02-13 04:54:25,301 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=22d440af5bfcfc9939787c5bb9ea8367, ASSIGN 2023-02-13 04:54:25,302 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=22d440af5bfcfc9939787c5bb9ea8367, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:54:25,453 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=22d440af5bfcfc9939787c5bb9ea8367, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:25,453 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676264065453"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264065453"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264065453"}]},"ts":"1676264065453"} 2023-02-13 04:54:25,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 22d440af5bfcfc9939787c5bb9ea8367, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:25,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 04:54:25,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:25,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 22d440af5bfcfc9939787c5bb9ea8367, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:54:25,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:54:25,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:25,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:54:25,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:54:25,611 INFO [StoreOpener-22d440af5bfcfc9939787c5bb9ea8367-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:54:25,612 DEBUG [StoreOpener-22d440af5bfcfc9939787c5bb9ea8367-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1 2023-02-13 04:54:25,612 DEBUG [StoreOpener-22d440af5bfcfc9939787c5bb9ea8367-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1 2023-02-13 04:54:25,612 INFO [StoreOpener-22d440af5bfcfc9939787c5bb9ea8367-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 22d440af5bfcfc9939787c5bb9ea8367 columnFamilyName family1 2023-02-13 04:54:25,614 INFO [StoreOpener-22d440af5bfcfc9939787c5bb9ea8367-1] regionserver.HStore(310): Store=22d440af5bfcfc9939787c5bb9ea8367/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:25,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:54:25,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:54:25,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:54:25,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:54:25,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 22d440af5bfcfc9939787c5bb9ea8367; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73228448, jitterRate=0.09118890762329102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:54:25,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 22d440af5bfcfc9939787c5bb9ea8367: Running coprocessor pre-open hook at 1676264065610Writing region info on filesystem at 1676264065610Initializing all the Stores at 1676264065610Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676264065610Cleaning up temporary data from old regions at 1676264065616 (+6 ms)Cleaning up detritus from prior splits at 1676264065616Running coprocessor post-open hooks at 1676264065620 (+4 ms)Region opened successfully at 1676264065620 2023-02-13 04:54:25,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367., pid=37, masterSystemTime=1676264065606 2023-02-13 04:54:25,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:25,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:25,623 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=22d440af5bfcfc9939787c5bb9ea8367, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:25,623 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676264065622"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264065622"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264065622"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264065622"}]},"ts":"1676264065622"} 2023-02-13 04:54:25,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-13 04:54:25,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 22d440af5bfcfc9939787c5bb9ea8367, server=jenkins-hbase4.apache.org,37513,1676264019660 in 170 msec 2023-02-13 04:54:25,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-13 04:54:25,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=22d440af5bfcfc9939787c5bb9ea8367, ASSIGN in 326 msec 2023-02-13 04:54:25,628 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:54:25,628 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264065628"}]},"ts":"1676264065628"} 2023-02-13 04:54:25,629 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 04:54:25,631 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:54:25,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1600 sec 2023-02-13 04:54:25,653 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/.tmp/family1/329d6bbf47f94031ae6fa8a0a9d9338a as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/329d6bbf47f94031ae6fa8a0a9d9338a 2023-02-13 04:54:25,658 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e994b917f8df7b3d815819b2163f57fb/family1 of e994b917f8df7b3d815819b2163f57fb into 329d6bbf47f94031ae6fa8a0a9d9338a(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:54:25,658 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e994b917f8df7b3d815819b2163f57fb: 2023-02-13 04:54:25,658 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676264064423; duration=1sec 2023-02-13 04:54:25,659 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:25,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/991f8bcf1f874e3abe2ee62846f45cd9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/ee34cb4cde3243c19b05797b681d2df9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/cf1e6c14d59949c9872e76b3ec753e1e_SeqId_12_] to archive 2023-02-13 04:54:25,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:25,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/991f8bcf1f874e3abe2ee62846f45cd9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/991f8bcf1f874e3abe2ee62846f45cd9 2023-02-13 04:54:25,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/ee34cb4cde3243c19b05797b681d2df9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/ee34cb4cde3243c19b05797b681d2df9 2023-02-13 04:54:25,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/cf1e6c14d59949c9872e76b3ec753e1e_SeqId_12_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/family1/cf1e6c14d59949c9872e76b3ec753e1e_SeqId_12_ 2023-02-13 04:54:26,193 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:54:26,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 04:54:26,579 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-13 04:54:26,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:26,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:26,603 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:26,603 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:26,603 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:26,603 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:26,603 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:26,603 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:26,604 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:26,604 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:26,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:26,605 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:26,605 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:26,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:26,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:26,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:26,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:26,606 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:26,606 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:26,606 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:26,606 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:26,606 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:26,606 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:26,606 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:26,607 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 04:54:27,026 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301b24c3861787409b84be9a50eaf597d6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511301b24c3861787409b84be9a50eaf597d6 2023-02-13 04:54:27,029 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/4b196a2a3f60476d9308f9909722bd16 2023-02-13 04:54:27,034 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/4b196a2a3f60476d9308f9909722bd16 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/4b196a2a3f60476d9308f9909722bd16 2023-02-13 04:54:27,038 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/4b196a2a3f60476d9308f9909722bd16, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 04:54:27,039 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 432ms, sequenceid=5, compaction requested=false 2023-02-13 04:54:27,039 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:27,039 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:27,039 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:27,039 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:27,039 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:27,039 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,039 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:27,039 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:27,041 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,041 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:27,041 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,041 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:27,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:27,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:27,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:27,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51c08839[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:27,042 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:27,042 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,043 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,044 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:27,044 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:27,044 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:27,044 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,044 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:27,046 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:27,046 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,046 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:27,046 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:27,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:27,048 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:27,048 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:27,048 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:27,048 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,048 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:27,049 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,049 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:27,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,049 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:27,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:27,050 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:27,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,051 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:27,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,053 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:27,053 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:27,053 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:27,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:27,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:27,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:27,053 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:27,054 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,054 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,054 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,054 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,054 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,054 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:27,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:27,054 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,054 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:27,154 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:27,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:27,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:27,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:27,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,162 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:27,162 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:27,162 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:27,162 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:27,162 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,162 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,164 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:27,164 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:27,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:27,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:27,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:27,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,166 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,166 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:27,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:27,166 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:27,166 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:27,166 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:27,166 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:27,166 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:27,166 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:27,166 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:27,166 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 04:54:27,580 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280ee66bf18dbb466ba2935ace72163a4b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511280ee66bf18dbb466ba2935ace72163a4b 2023-02-13 04:54:27,988 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/77ce27edbd2145a9a641685cac9ac1f0 2023-02-13 04:54:27,993 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/77ce27edbd2145a9a641685cac9ac1f0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/77ce27edbd2145a9a641685cac9ac1f0 2023-02-13 04:54:27,997 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/77ce27edbd2145a9a641685cac9ac1f0, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 04:54:27,998 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 832ms, sequenceid=9, compaction requested=false 2023-02-13 04:54:27,998 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:27,998 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:27,998 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:28,001 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,001 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:28,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:28,002 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,002 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:28,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:28,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bd58aa1[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:28,003 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:28,003 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,008 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,008 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,008 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:28,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,008 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:28,008 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:28,008 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:28,009 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:28,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:28,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:28,012 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:28,012 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:28,012 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:28,012 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,012 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:28,014 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,014 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:28,014 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:28,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:28,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:28,015 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:28,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,016 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:28,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,018 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,018 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:28,018 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:28,019 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,019 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,019 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:28,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:28,019 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:28,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:28,019 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,019 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:28,019 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:28,019 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:28,019 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:28,119 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:28,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:28,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:28,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:28,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,127 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:28,127 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:28,127 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:28,127 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:28,128 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,128 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,129 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:28,129 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:28,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:28,130 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,130 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:28,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:28,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,131 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,131 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:28,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:28,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:28,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:28,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:28,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:28,132 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:28,132 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:28,132 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:28,549 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201405adc559a6e45bcb544c1014e8e22ec to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201405adc559a6e45bcb544c1014e8e22ec 2023-02-13 04:54:28,955 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/d66575670d8c429cb20be9c52276ddf2 2023-02-13 04:54:28,960 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/d66575670d8c429cb20be9c52276ddf2 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/d66575670d8c429cb20be9c52276ddf2 2023-02-13 04:54:28,965 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/d66575670d8c429cb20be9c52276ddf2, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 04:54:28,966 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 834ms, sequenceid=13, compaction requested=true 2023-02-13 04:54:28,966 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:28,966 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:28,966 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:28,968 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,968 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:28,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:28,968 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:28,968 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:28,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:28,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cd9ff4f[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:28,970 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:28,970 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,971 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:28,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:28,971 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,971 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:28,973 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,973 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:28,974 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:28,974 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:28,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:28,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:28,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:28,976 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:28,976 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:28,976 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:28,976 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,976 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:28,977 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,977 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,977 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:28,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:28,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:28,978 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,979 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:28,981 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:28,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:28,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:28,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:28,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:28,981 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:28,982 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:28,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:28,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:29,082 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:29,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:29,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:29,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:29,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,088 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:29,088 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:29,088 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:29,088 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:29,089 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,089 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,090 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:29,090 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:29,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:29,090 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,090 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:29,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,091 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,091 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:29,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:29,092 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:29,092 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:29,092 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:29,092 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:29,105 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051533a3dea79a4d2aa4c9dc6f40ba1cd3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051533a3dea79a4d2aa4c9dc6f40ba1cd3 2023-02-13 04:54:29,511 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/7319fce590fb48d7801229496d688245 2023-02-13 04:54:29,516 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/7319fce590fb48d7801229496d688245 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/7319fce590fb48d7801229496d688245 2023-02-13 04:54:29,521 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/7319fce590fb48d7801229496d688245, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 04:54:29,522 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 430ms, sequenceid=17, compaction requested=true 2023-02-13 04:54:29,522 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:29,522 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:29,522 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:29,522 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:29,523 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,523 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:29,523 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:29,524 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,524 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:29,525 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,525 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:29,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:29,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c66bdec[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:29,526 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:29,526 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,527 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,528 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:29,528 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:29,528 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:29,528 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,528 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:29,530 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,530 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:29,530 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:29,530 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:29,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:29,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:29,533 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:29,533 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:29,533 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:29,533 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,533 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:29,535 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,535 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:29,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,535 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:29,535 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,537 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:29,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:29,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,539 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:29,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:29,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:29,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:29,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:29,539 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:29,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:29,540 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,540 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,540 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:29,540 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:29,640 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:29,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:29,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:29,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:29,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,647 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:29,648 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:29,648 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:29,648 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:29,648 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,648 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,649 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,649 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:29,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:29,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:29,650 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:29,650 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:29,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:29,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,651 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,651 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:29,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:29,651 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:29,651 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:29,651 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:29,652 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:30,070 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c81a5ac1f19748ef9a279aa4eab78205 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c81a5ac1f19748ef9a279aa4eab78205 2023-02-13 04:54:30,477 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/bcc16edc627744bb8aee030949420aef 2023-02-13 04:54:30,484 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/bcc16edc627744bb8aee030949420aef as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/bcc16edc627744bb8aee030949420aef 2023-02-13 04:54:30,490 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/bcc16edc627744bb8aee030949420aef, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 04:54:30,491 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 839ms, sequenceid=21, compaction requested=true 2023-02-13 04:54:30,491 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:30,491 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:30,491 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:30,491 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:30,491 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,491 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:30,491 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:30,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,497 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:30,497 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,497 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:30,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:30,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:30,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9327719[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:30,499 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:30,499 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,500 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,500 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:30,500 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:30,500 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:30,501 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:30,501 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,501 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:30,502 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:30,502 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:30,502 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:30,502 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:30,502 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:30,502 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:30,502 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,502 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:30,504 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,504 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:30,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:30,504 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:30,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:30,505 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,506 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:30,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,509 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,509 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,509 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:30,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:30,510 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:30,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:30,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:30,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:30,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:30,510 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:30,510 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:30,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:30,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:30,610 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:30,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:30,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:30,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:30,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,617 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:30,617 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:30,617 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:30,617 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:30,617 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,617 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,618 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,618 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:30,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:30,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:30,619 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:30,619 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:30,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:30,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,619 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,620 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:30,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:30,620 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:30,620 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:30,620 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:30,620 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:30,620 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:30,620 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:30,620 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:30,620 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:31,033 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316ced844b80e74f61b3d9eba7112e139c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512316ced844b80e74f61b3d9eba7112e139c 2023-02-13 04:54:31,041 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/33fc051f7f6147b6b2816d607658f4eb 2023-02-13 04:54:31,045 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/33fc051f7f6147b6b2816d607658f4eb as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/33fc051f7f6147b6b2816d607658f4eb 2023-02-13 04:54:31,049 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/33fc051f7f6147b6b2816d607658f4eb, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 04:54:31,050 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 430ms, sequenceid=25, compaction requested=true 2023-02-13 04:54:31,050 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:31,050 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:31,050 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:31,050 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:31,050 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,051 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:31,051 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:31,053 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:31,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:31,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e65641c[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:31,054 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:31,055 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,056 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,056 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:31,056 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:31,056 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:31,056 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,056 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:31,057 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:31,057 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:31,057 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,057 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:31,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:31,059 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:31,059 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:31,059 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:31,059 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,059 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:31,061 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,061 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,061 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:31,061 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:31,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,063 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,066 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,066 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:31,066 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:31,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:31,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:31,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:31,066 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:31,066 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,066 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:31,066 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,066 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,066 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:31,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:31,066 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,067 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:31,067 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,111 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:54:31,167 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:31,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:31,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:31,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:31,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,173 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:31,173 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:31,173 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:31,173 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:31,174 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,174 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,175 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,175 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:31,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:31,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:31,175 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:31,175 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:31,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:31,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,176 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,176 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:31,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:31,176 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:31,176 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:31,176 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:31,177 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:31,177 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:31,177 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:31,177 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:31,177 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:31,589 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012433437a02464e68a1900ad69d5aaa84 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601012433437a02464e68a1900ad69d5aaa84 2023-02-13 04:54:31,995 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/1f28bc02c04d401a8ac1fab62ff50e83 2023-02-13 04:54:32,000 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/1f28bc02c04d401a8ac1fab62ff50e83 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/1f28bc02c04d401a8ac1fab62ff50e83 2023-02-13 04:54:32,003 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/1f28bc02c04d401a8ac1fab62ff50e83, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 04:54:32,004 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 827ms, sequenceid=29, compaction requested=true 2023-02-13 04:54:32,004 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:32,004 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:32,004 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:32,005 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:32,005 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,005 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:32,005 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:32,006 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,006 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:32,007 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,007 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:32,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:32,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6df5cb18[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:32,008 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:32,008 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,009 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,009 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,009 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:32,009 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:32,009 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:32,009 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:32,011 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:32,011 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,011 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:32,011 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:32,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:32,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:32,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:32,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:32,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:32,013 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:32,013 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:32,013 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:32,013 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,013 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:32,018 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,018 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:32,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:32,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,018 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:32,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:32,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:32,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:32,018 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,019 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:32,022 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:32,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:32,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:32,022 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:32,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:32,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:32,122 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:32,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:32,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:32,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:32,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,129 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:32,129 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:32,129 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:32,129 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:32,130 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,130 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,141 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,141 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:32,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:32,141 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,141 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,142 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:32,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:32,142 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:32,142 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:32,143 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:32,562 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103343f10646c434e27beb7fdb8a611f03f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103343f10646c434e27beb7fdb8a611f03f 2023-02-13 04:54:32,967 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/c2009b7a443248b5be9d31fabe5c4b07 2023-02-13 04:54:32,972 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/c2009b7a443248b5be9d31fabe5c4b07 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/c2009b7a443248b5be9d31fabe5c4b07 2023-02-13 04:54:32,976 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/c2009b7a443248b5be9d31fabe5c4b07, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 04:54:32,977 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 834ms, sequenceid=33, compaction requested=true 2023-02-13 04:54:32,977 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:32,977 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:32,977 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:32,977 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:32,977 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:32,978 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:32,979 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,979 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:32,980 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,980 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:32,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:32,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4158297[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:32,981 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:32,981 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,983 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:32,983 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,983 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:32,984 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,984 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:32,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:32,984 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:32,985 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:32,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:32,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:32,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:32,987 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:32,987 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:32,987 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:32,987 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,987 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:32,989 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,989 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:32,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,989 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:32,989 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,991 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:32,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,993 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,993 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:32,993 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:32,993 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:32,993 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:32,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:32,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:32,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:32,993 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,993 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:32,993 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,993 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,994 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:32,994 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:32,994 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:32,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:32,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:33,094 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:33,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:33,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:33,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:33,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,101 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:33,101 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:33,101 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:33,101 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:33,101 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,102 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,103 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,103 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:33,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:33,103 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,103 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,104 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,104 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:33,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:33,104 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:33,105 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:33,105 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:33,105 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:33,519 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907466f0a8a8bd24ae4b95e11850c46ca29 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907466f0a8a8bd24ae4b95e11850c46ca29 2023-02-13 04:54:33,527 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/b49e12e3f9cc4a838bec3f05b99f87dd 2023-02-13 04:54:33,532 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/b49e12e3f9cc4a838bec3f05b99f87dd as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/b49e12e3f9cc4a838bec3f05b99f87dd 2023-02-13 04:54:33,541 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/b49e12e3f9cc4a838bec3f05b99f87dd, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 04:54:33,543 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 438ms, sequenceid=37, compaction requested=true 2023-02-13 04:54:33,544 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:33,544 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:33,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:33,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:33,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:33,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:33,545 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,546 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:33,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:33,547 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:33,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e85a7b3[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:33,547 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,550 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,550 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:33,550 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:33,550 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:33,550 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,550 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:33,551 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:33,552 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:33,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:33,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:33,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:33,555 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:33,555 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:33,555 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:33,555 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,555 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:33,556 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,556 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,556 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:33,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:33,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,557 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:33,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:33,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,559 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:33,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,561 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,561 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:33,561 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:33,561 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:33,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:33,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:33,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 04:54:33,561 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:33,561 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:33,561 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,562 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,562 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,562 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,562 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:33,562 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:33,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:33,662 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:33,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:33,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:33,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:33,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,669 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:33,670 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:33,670 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 04:54:33,670 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 04:54:33,670 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,670 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,673 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,673 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:33,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:33,673 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:33,673 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 04:54:33,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:33,674 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 04:54:33,674 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:33,674 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 04:54:33,674 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:33,674 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:33,674 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:33,674 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. started... 2023-02-13 04:54:33,674 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 22d440af5bfcfc9939787c5bb9ea8367 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:34,092 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120202c64027d684694bf239c4bedfd4dea to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120202c64027d684694bf239c4bedfd4dea 2023-02-13 04:54:34,498 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/5360f0fbd581432c858db94299cd519d 2023-02-13 04:54:34,503 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/5360f0fbd581432c858db94299cd519d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/5360f0fbd581432c858db94299cd519d 2023-02-13 04:54:34,508 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/5360f0fbd581432c858db94299cd519d, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 04:54:34,509 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 22d440af5bfcfc9939787c5bb9ea8367 in 835ms, sequenceid=41, compaction requested=true 2023-02-13 04:54:34,509 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:34,509 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:34,509 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:34,509 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:34,509 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,509 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 04:54:34,509 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 04:54:34,516 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,516 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:34,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:34,516 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,517 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:34,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:34,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:34,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:34,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 04:54:34,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bb575fb[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:34,518 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 04:54:34,518 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,520 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,520 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 04:54:34,520 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 04:54:34,520 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,520 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:34,520 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:34,521 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 04:54:34,521 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,521 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:34,521 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 04:54:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:34,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:54:34,523 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 04:54:34,524 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:34,524 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:34,524 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,524 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:34,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:34,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:34,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,525 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:34,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:34,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:34,526 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:34,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,527 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:34,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,532 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,532 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:34,532 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,532 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:34,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 04:54:34,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:34,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:34,533 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:34,533 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:34,533 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:34,533 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,533 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,533 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:34,533 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:34,533 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:34,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:34,633 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:34,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:34,635 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-13 04:54:34,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:54:34,639 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:54:34,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:34,640 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264674640 2023-02-13 04:54:34,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:54:34,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 04:54:34,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:34,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x240409e1 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:54:34,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@611e02bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:54:34,655 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,493 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038162162e5d8b464ab40a13efde0fb9a3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601038162162e5d8b464ab40a13efde0fb9a3 2023-02-13 04:54:35,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:35,511 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:54:35,512 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:54:35,519 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:54:35,520 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46922, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:54:35,529 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3a3845c4151a47fc8da92cfe05e7624b first=Optional[r3] last=Optional[r6] 2023-02-13 04:54:35,530 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3a3845c4151a47fc8da92cfe05e7624b}] 2023-02-13 04:54:35,534 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3a3845c4151a47fc8da92cfe05e7624b for inclusion in 22d440af5bfcfc9939787c5bb9ea8367/family1 2023-02-13 04:54:35,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 04:54:35,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:35,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:35,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3a3845c4151a47fc8da92cfe05e7624b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c4nli2bjkkrv7e5sustft2mldo8ta1kk3foqmt6o4gqd5aukp09mvv5tlof67n1l/family1/3a3845c4151a47fc8da92cfe05e7624b 2023-02-13 04:54:35,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c4nli2bjkkrv7e5sustft2mldo8ta1kk3foqmt6o4gqd5aukp09mvv5tlof67n1l/family1/3a3845c4151a47fc8da92cfe05e7624b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/de458232869b4acc9809482e96fdb607_SeqId_44_ 2023-02-13 04:54:35,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c4nli2bjkkrv7e5sustft2mldo8ta1kk3foqmt6o4gqd5aukp09mvv5tlof67n1l/family1/3a3845c4151a47fc8da92cfe05e7624b into 22d440af5bfcfc9939787c5bb9ea8367/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/de458232869b4acc9809482e96fdb607_SeqId_44_ - updating store file list. 2023-02-13 04:54:35,544 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/de458232869b4acc9809482e96fdb607_SeqId_44_ into 22d440af5bfcfc9939787c5bb9ea8367/family1 2023-02-13 04:54:35,544 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c4nli2bjkkrv7e5sustft2mldo8ta1kk3foqmt6o4gqd5aukp09mvv5tlof67n1l/family1/3a3845c4151a47fc8da92cfe05e7624b into 22d440af5bfcfc9939787c5bb9ea8367/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/de458232869b4acc9809482e96fdb607_SeqId_44_) 2023-02-13 04:54:35,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c4nli2bjkkrv7e5sustft2mldo8ta1kk3foqmt6o4gqd5aukp09mvv5tlof67n1l/family1/3a3845c4151a47fc8da92cfe05e7624b 2023-02-13 04:54:35,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 04:54:35,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 04:54:35,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): 22d440af5bfcfc9939787c5bb9ea8367/family1 is initiating minor compaction 2023-02-13 04:54:35,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@55865966; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:35,547 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 22d440af5bfcfc9939787c5bb9ea8367/family1 in testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:54:35,548 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/77ce27edbd2145a9a641685cac9ac1f0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/d66575670d8c429cb20be9c52276ddf2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/7319fce590fb48d7801229496d688245, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/bcc16edc627744bb8aee030949420aef, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/33fc051f7f6147b6b2816d607658f4eb, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/1f28bc02c04d401a8ac1fab62ff50e83, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/c2009b7a443248b5be9d31fabe5c4b07, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/b49e12e3f9cc4a838bec3f05b99f87dd, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/5360f0fbd581432c858db94299cd519d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/de458232869b4acc9809482e96fdb607_SeqId_44_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp, totalSize=50.0 K 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 77ce27edbd2145a9a641685cac9ac1f0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting d66575670d8c429cb20be9c52276ddf2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 7319fce590fb48d7801229496d688245, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting bcc16edc627744bb8aee030949420aef, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 33fc051f7f6147b6b2816d607658f4eb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 1f28bc02c04d401a8ac1fab62ff50e83, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting c2009b7a443248b5be9d31fabe5c4b07, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting b49e12e3f9cc4a838bec3f05b99f87dd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 5360f0fbd581432c858db94299cd519d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 04:54:35,548 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting de458232869b4acc9809482e96fdb607_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 04:54:35,550 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:35,551 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:35,552 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c81a5ac1f19748ef9a279aa4eab78205 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228c81a5ac1f19748ef9a279aa4eab78205 2023-02-13 04:54:35,554 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512316ced844b80e74f61b3d9eba7112e139c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512316ced844b80e74f61b3d9eba7112e139c 2023-02-13 04:54:35,555 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601012433437a02464e68a1900ad69d5aaa84 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601012433437a02464e68a1900ad69d5aaa84 2023-02-13 04:54:35,556 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103343f10646c434e27beb7fdb8a611f03f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103343f10646c434e27beb7fdb8a611f03f 2023-02-13 04:54:35,556 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 04:54:35,556 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 04:54:35,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,598 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 22d440af5bfcfc9939787c5bb9ea8367#family1#compaction#49 average throughput is 0.19 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:54:35,640 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205909f193e9ec14bbfb171a909b72c0aac to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205909f193e9ec14bbfb171a909b72c0aac 2023-02-13 04:54:35,642 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:35,677 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e249d0f0991647e5b426db2ce1070dfe first=Optional[r00] last=Optional[r2] 2023-02-13 04:54:35,678 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e249d0f0991647e5b426db2ce1070dfe}] 2023-02-13 04:54:35,680 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e249d0f0991647e5b426db2ce1070dfe for inclusion in 22d440af5bfcfc9939787c5bb9ea8367/family1 2023-02-13 04:54:35,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 04:54:35,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:35,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:35,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e249d0f0991647e5b426db2ce1070dfe to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oubdbr0d334n4drb3hhc6ed9eg1i4iaf46fh5dgadef3ln76pjlipda9h77ti11r/family1/e249d0f0991647e5b426db2ce1070dfe 2023-02-13 04:54:35,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oubdbr0d334n4drb3hhc6ed9eg1i4iaf46fh5dgadef3ln76pjlipda9h77ti11r/family1/e249d0f0991647e5b426db2ce1070dfe as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/fbf670cc71dc4dec955e0537b894b171_SeqId_46_ 2023-02-13 04:54:35,687 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oubdbr0d334n4drb3hhc6ed9eg1i4iaf46fh5dgadef3ln76pjlipda9h77ti11r/family1/e249d0f0991647e5b426db2ce1070dfe into 22d440af5bfcfc9939787c5bb9ea8367/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/fbf670cc71dc4dec955e0537b894b171_SeqId_46_ - updating store file list. 2023-02-13 04:54:35,691 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/fbf670cc71dc4dec955e0537b894b171_SeqId_46_ into 22d440af5bfcfc9939787c5bb9ea8367/family1 2023-02-13 04:54:35,691 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oubdbr0d334n4drb3hhc6ed9eg1i4iaf46fh5dgadef3ln76pjlipda9h77ti11r/family1/e249d0f0991647e5b426db2ce1070dfe into 22d440af5bfcfc9939787c5bb9ea8367/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/fbf670cc71dc4dec955e0537b894b171_SeqId_46_) 2023-02-13 04:54:35,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyPolicy__oubdbr0d334n4drb3hhc6ed9eg1i4iaf46fh5dgadef3ln76pjlipda9h77ti11r/family1/e249d0f0991647e5b426db2ce1070dfe 2023-02-13 04:54:35,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:35,695 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:35,696 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511301b24c3861787409b84be9a50eaf597d6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511301b24c3861787409b84be9a50eaf597d6 2023-02-13 04:54:35,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201405adc559a6e45bcb544c1014e8e22ec to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201405adc559a6e45bcb544c1014e8e22ec 2023-02-13 04:54:35,699 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051533a3dea79a4d2aa4c9dc6f40ba1cd3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051533a3dea79a4d2aa4c9dc6f40ba1cd3 2023-02-13 04:54:35,699 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-13 04:54:35,699 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 04:54:35,700 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 04:54:35,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 04:54:35,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:35,702 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:54:35,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0660 sec 2023-02-13 04:54:35,819 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=263 (was 251) - Thread LEAK? -, OpenFileDescriptor=636 (was 604) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=264 (was 219) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3981 (was 4418) 2023-02-13 04:54:35,831 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=263, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=264, ProcessCount=168, AvailableMemoryMB=3981 2023-02-13 04:54:35,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 04:54:35,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:35,836 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:54:35,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-13 04:54:35,837 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:54:35,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 04:54:35,838 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:35,839 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb empty. 2023-02-13 04:54:35,839 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:35,839 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-13 04:54:35,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 04:54:36,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 04:54:36,248 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 04:54:36,249 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => e3140d42d553dab37e6b41019f32deeb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:54:36,256 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:36,257 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing e3140d42d553dab37e6b41019f32deeb, disabling compactions & flushes 2023-02-13 04:54:36,257 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:36,257 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:36,257 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. after waiting 0 ms 2023-02-13 04:54:36,257 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:36,257 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:36,257 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for e3140d42d553dab37e6b41019f32deeb: Waiting for close lock at 1676264076257Disabling compacts and flushes for region at 1676264076257Disabling writes for close at 1676264076257Writing region close event to WAL at 1676264076257Closed at 1676264076257 2023-02-13 04:54:36,259 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:54:36,260 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264076260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264076260"}]},"ts":"1676264076260"} 2023-02-13 04:54:36,261 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:54:36,262 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:54:36,262 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264076262"}]},"ts":"1676264076262"} 2023-02-13 04:54:36,263 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-13 04:54:36,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, ASSIGN}] 2023-02-13 04:54:36,267 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, ASSIGN 2023-02-13 04:54:36,268 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:54:36,419 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:36,419 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/.tmp/family1/281ec9a7460f4d26b4af8679d7bd522c as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/281ec9a7460f4d26b4af8679d7bd522c 2023-02-13 04:54:36,419 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264076419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264076419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264076419"}]},"ts":"1676264076419"} 2023-02-13 04:54:36,421 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:36,425 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 22d440af5bfcfc9939787c5bb9ea8367/family1 of 22d440af5bfcfc9939787c5bb9ea8367 into 281ec9a7460f4d26b4af8679d7bd522c(size=6.6 K), total size for store is 337.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:54:36,425 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 22d440af5bfcfc9939787c5bb9ea8367: 2023-02-13 04:54:36,425 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676264075547; duration=0sec 2023-02-13 04:54:36,425 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:36,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/77ce27edbd2145a9a641685cac9ac1f0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/d66575670d8c429cb20be9c52276ddf2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/7319fce590fb48d7801229496d688245, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/bcc16edc627744bb8aee030949420aef, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/33fc051f7f6147b6b2816d607658f4eb, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/1f28bc02c04d401a8ac1fab62ff50e83, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/c2009b7a443248b5be9d31fabe5c4b07, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/b49e12e3f9cc4a838bec3f05b99f87dd, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/5360f0fbd581432c858db94299cd519d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/de458232869b4acc9809482e96fdb607_SeqId_44_] to archive 2023-02-13 04:54:36,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 04:54:36,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:36,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/77ce27edbd2145a9a641685cac9ac1f0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/77ce27edbd2145a9a641685cac9ac1f0 2023-02-13 04:54:36,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/d66575670d8c429cb20be9c52276ddf2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/d66575670d8c429cb20be9c52276ddf2 2023-02-13 04:54:36,446 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/7319fce590fb48d7801229496d688245 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/7319fce590fb48d7801229496d688245 2023-02-13 04:54:36,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/bcc16edc627744bb8aee030949420aef to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/bcc16edc627744bb8aee030949420aef 2023-02-13 04:54:36,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/33fc051f7f6147b6b2816d607658f4eb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/33fc051f7f6147b6b2816d607658f4eb 2023-02-13 04:54:36,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/1f28bc02c04d401a8ac1fab62ff50e83 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/1f28bc02c04d401a8ac1fab62ff50e83 2023-02-13 04:54:36,450 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/c2009b7a443248b5be9d31fabe5c4b07 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/c2009b7a443248b5be9d31fabe5c4b07 2023-02-13 04:54:36,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/b49e12e3f9cc4a838bec3f05b99f87dd to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/b49e12e3f9cc4a838bec3f05b99f87dd 2023-02-13 04:54:36,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/5360f0fbd581432c858db94299cd519d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/5360f0fbd581432c858db94299cd519d 2023-02-13 04:54:36,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/de458232869b4acc9809482e96fdb607_SeqId_44_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/family1/de458232869b4acc9809482e96fdb607_SeqId_44_ 2023-02-13 04:54:36,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:36,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e3140d42d553dab37e6b41019f32deeb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:54:36,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:36,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:36,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:36,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:36,578 INFO [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:36,580 DEBUG [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:36,580 DEBUG [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:36,581 INFO [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3140d42d553dab37e6b41019f32deeb columnFamilyName family1 2023-02-13 04:54:36,582 INFO [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] regionserver.HStore(310): Store=e3140d42d553dab37e6b41019f32deeb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:36,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:36,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:36,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:36,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:54:36,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e3140d42d553dab37e6b41019f32deeb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67650792, jitterRate=0.008075356483459473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:54:36,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e3140d42d553dab37e6b41019f32deeb: Running coprocessor pre-open hook at 1676264076577Writing region info on filesystem at 1676264076577Initializing all the Stores at 1676264076578 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676264076578Cleaning up temporary data from old regions at 1676264076584 (+6 ms)Cleaning up detritus from prior splits at 1676264076585 (+1 ms)Running coprocessor post-open hooks at 1676264076589 (+4 ms)Region opened successfully at 1676264076589 2023-02-13 04:54:36,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb., pid=41, masterSystemTime=1676264076573 2023-02-13 04:54:36,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:36,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:36,592 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:36,592 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264076592"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264076592"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264076592"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264076592"}]},"ts":"1676264076592"} 2023-02-13 04:54:36,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-13 04:54:36,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660 in 173 msec 2023-02-13 04:54:36,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-13 04:54:36,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, ASSIGN in 330 msec 2023-02-13 04:54:36,600 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:54:36,600 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264076600"}]},"ts":"1676264076600"} 2023-02-13 04:54:36,601 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-13 04:54:36,605 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:54:36,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 771 msec 2023-02-13 04:54:36,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 04:54:36,942 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-13 04:54:36,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:36,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:36,968 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:36,968 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:36,968 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:36,968 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:36,968 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:36,968 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:36,969 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:36,969 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:36,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:36,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:36,970 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:36,970 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:36,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:36,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:36,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:36,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:36,971 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:36,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:36,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:36,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:36,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:36,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:36,971 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:36,971 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:36,971 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:36,972 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 04:54:37,393 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302659af6fac5a4359aeeca5deadad3783 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511302659af6fac5a4359aeeca5deadad3783 2023-02-13 04:54:37,797 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/efb96a7e56b645bfa797f7513c3a6975 2023-02-13 04:54:37,803 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/efb96a7e56b645bfa797f7513c3a6975 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/efb96a7e56b645bfa797f7513c3a6975 2023-02-13 04:54:37,809 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/efb96a7e56b645bfa797f7513c3a6975, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-13 04:54:37,810 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 837ms, sequenceid=5, compaction requested=false 2023-02-13 04:54:37,810 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:37,810 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:37,810 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:37,810 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:37,810 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:37,810 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,811 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:37,811 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,812 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:37,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:37,812 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,813 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:37,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:37,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:37,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@285bce9e[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:37,814 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:37,814 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,816 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,816 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:37,816 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:37,816 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:37,817 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,817 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:37,818 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:37,818 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:37,818 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,818 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:37,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:37,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:37,821 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:37,821 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:37,821 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:37,821 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,821 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:37,823 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,823 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:37,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,823 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:37,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:37,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:37,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:37,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,824 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:37,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,825 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:37,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,829 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,829 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:37,829 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,829 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:37,829 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:37,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:37,829 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:37,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:37,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:37,830 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:37,830 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:37,829 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,830 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,830 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,830 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:37,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:37,930 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:37,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:37,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:37,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:37,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,936 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:37,936 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:37,936 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:37,936 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:37,937 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,937 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,938 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,938 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:37,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:37,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:37,938 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:37,938 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:37,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:37,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,939 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 04:54:37,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:37,939 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:37,939 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:37,939 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:37,940 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:37,940 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:37,940 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:37,940 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:37,940 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 04:54:38,359 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287417041eaeca4fc08f24079a0f8f7ce7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287417041eaeca4fc08f24079a0f8f7ce7 2023-02-13 04:54:38,766 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/37fd48326d3d4f9399f9881356f03a73 2023-02-13 04:54:38,772 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/37fd48326d3d4f9399f9881356f03a73 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/37fd48326d3d4f9399f9881356f03a73 2023-02-13 04:54:38,777 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/37fd48326d3d4f9399f9881356f03a73, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 04:54:38,778 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 838ms, sequenceid=9, compaction requested=false 2023-02-13 04:54:38,778 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:38,778 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:38,778 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:38,778 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:38,778 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,778 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:38,778 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:38,780 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,780 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:38,780 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,780 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:38,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:38,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:38,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:38,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:38,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72e038[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:38,782 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:38,782 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,784 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,784 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,784 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:38,784 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:38,785 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:38,786 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:38,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:38,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:38,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:38,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:38,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:38,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:38,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:38,789 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:38,789 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:38,789 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:38,789 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,789 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:38,791 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,791 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:38,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,791 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:38,791 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,793 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,799 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,799 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:38,799 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:38,799 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:38,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:38,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:38,799 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:38,799 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,800 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,800 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 04:54:38,800 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,800 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:38,800 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:38,800 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:38,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:38,900 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:38,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:38,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:38,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:38,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,906 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:38,907 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:38,907 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:38,907 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:38,907 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,907 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,908 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,908 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:38,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:38,908 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:38,909 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,909 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,909 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 04:54:38,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:38,910 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:38,910 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:38,910 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:38,910 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:38,910 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:38,910 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:38,910 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:38,910 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:39,322 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201dc4ba02a13ad49b88c59c474cb2a8c99 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201dc4ba02a13ad49b88c59c474cb2a8c99 2023-02-13 04:54:39,346 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:54:39,346 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x240409e1 to 127.0.0.1:54862 2023-02-13 04:54:39,346 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:54:39,346 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:54:39,346 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31da6de8 to 127.0.0.1:54862 2023-02-13 04:54:39,346 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:54:39,347 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:54:39,347 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60833c61 to 127.0.0.1:54862 2023-02-13 04:54:39,347 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:54:39,750 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/901b328ea1d240a5956e880472d06f7c 2023-02-13 04:54:39,756 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/901b328ea1d240a5956e880472d06f7c as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/901b328ea1d240a5956e880472d06f7c 2023-02-13 04:54:39,765 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/901b328ea1d240a5956e880472d06f7c, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 04:54:39,766 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 856ms, sequenceid=13, compaction requested=true 2023-02-13 04:54:39,766 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:39,766 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:39,766 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:39,768 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:39,770 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:39,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,771 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,771 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:39,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:39,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:39,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@337977ba[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:39,773 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:39,773 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,774 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,774 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:39,774 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:39,774 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:39,774 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,774 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:39,777 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:39,778 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:39,778 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:39,778 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:39,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:39,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:39,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:39,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:39,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:39,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:39,782 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:39,782 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:39,782 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:39,782 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,782 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:39,786 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,786 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:39,786 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:39,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:39,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:39,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:39,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:39,789 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:39,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,791 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:39,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,794 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,794 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:39,794 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:39,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:39,794 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:39,794 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:39,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:39,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:39,794 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,794 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,794 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,794 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,794 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,795 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:39,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 04:54:39,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:39,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:39,795 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:39,895 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:39,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:39,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:39,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:39,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,902 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:39,902 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:39,902 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:39,902 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:39,903 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,903 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,904 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:39,904 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:39,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:39,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,905 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:39,905 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:39,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:39,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,905 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,905 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 04:54:39,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:39,906 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:39,906 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:39,906 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:39,906 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:39,906 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:39,906 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:39,906 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:39,906 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:40,321 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057be6dea39b49414ca88ae0f83b6c9372 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057be6dea39b49414ca88ae0f83b6c9372 2023-02-13 04:54:40,727 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/e6ede13d2fdc4445926058135f848fa0 2023-02-13 04:54:40,733 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/e6ede13d2fdc4445926058135f848fa0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e6ede13d2fdc4445926058135f848fa0 2023-02-13 04:54:40,738 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e6ede13d2fdc4445926058135f848fa0, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 04:54:40,739 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 833ms, sequenceid=17, compaction requested=true 2023-02-13 04:54:40,739 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:40,739 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:40,739 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:40,739 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:40,739 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,739 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:40,739 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:40,741 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:40,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:40,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:40,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:40,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7323c683[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:40,743 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:40,743 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,744 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,744 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:40,744 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:40,744 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,744 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:40,744 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:40,746 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:40,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:40,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:40,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:40,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:40,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:40,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:40,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:40,748 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:40,748 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:40,748 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:40,748 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,748 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:40,751 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,751 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:40,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:40,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,751 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:40,752 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:40,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:40,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:40,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:40,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,753 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:40,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,755 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:40,755 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,755 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:40,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:40,755 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:40,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:40,755 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:40,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:40,756 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,756 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,756 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,756 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,756 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:40,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:40,756 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:40,756 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:40,856 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:40,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:40,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:40,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:40,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,862 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:40,862 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:40,862 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:40,862 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:40,863 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,863 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,865 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:40,865 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:40,865 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:40,865 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:40,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:40,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,866 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,866 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 04:54:40,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:40,866 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:40,866 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:40,866 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:40,866 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:40,866 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:40,867 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:40,867 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:40,867 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:41,278 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228bc4c60c5463448bf8299ab7d42951fd0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc4c60c5463448bf8299ab7d42951fd0 2023-02-13 04:54:41,683 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/369f61f1c1a64a25bb9bf6bd15ee3123 2023-02-13 04:54:41,690 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/369f61f1c1a64a25bb9bf6bd15ee3123 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/369f61f1c1a64a25bb9bf6bd15ee3123 2023-02-13 04:54:41,694 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/369f61f1c1a64a25bb9bf6bd15ee3123, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 04:54:41,695 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 828ms, sequenceid=21, compaction requested=true 2023-02-13 04:54:41,695 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:41,695 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:41,695 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,700 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,700 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:41,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:41,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:41,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:41,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57ad947[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:41,701 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:41,701 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,702 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,703 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:41,703 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:41,703 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,703 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:41,703 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:41,704 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,704 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:41,704 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:41,704 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:41,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:41,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:41,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:41,706 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:41,706 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:41,706 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:41,706 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,706 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:41,707 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,707 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,707 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:41,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:41,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:41,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:41,708 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:41,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:41,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:41,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,709 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:41,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,712 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,712 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,712 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,712 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:41,712 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:41,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:41,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 04:54:41,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:41,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:41,712 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:41,712 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,712 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:41,713 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,713 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,713 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:41,713 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:41,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:41,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:41,813 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:41,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:41,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:41,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:41,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,820 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:41,820 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:41,820 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:41,820 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:41,821 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,821 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,823 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,823 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:41,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:41,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:41,823 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:41,823 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:41,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:41,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,824 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,824 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 04:54:41,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:41,824 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:41,824 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:41,824 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:41,825 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:41,825 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:41,825 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:41,825 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:41,825 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:41,838 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123166bb71acb7e941b8b6e5be8fe0e10c12 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123166bb71acb7e941b8b6e5be8fe0e10c12 2023-02-13 04:54:42,108 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:54:42,244 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/e833c5f3e1584f61a808372751414e5b 2023-02-13 04:54:42,249 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/e833c5f3e1584f61a808372751414e5b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e833c5f3e1584f61a808372751414e5b 2023-02-13 04:54:42,253 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e833c5f3e1584f61a808372751414e5b, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 04:54:42,254 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 429ms, sequenceid=25, compaction requested=true 2023-02-13 04:54:42,254 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:42,254 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:42,254 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:42,254 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:42,254 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,254 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:42,254 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:42,257 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,257 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:42,257 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,257 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:42,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:42,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@121e8af0[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:42,258 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:42,258 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,259 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,259 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:42,259 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:42,259 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:42,260 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,260 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:42,261 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:42,261 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,261 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:42,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,261 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:42,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:42,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:42,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:42,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:42,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:42,263 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:42,263 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:42,263 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:42,263 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,263 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:42,264 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,264 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:42,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:42,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,264 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:42,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:42,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:42,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:42,265 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:42,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,266 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:42,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,268 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,268 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,269 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,269 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,269 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:42,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:42,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:42,269 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:42,269 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:42,269 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:42,269 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:42,269 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,269 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:42,269 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:42,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:42,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:42,369 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:42,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:42,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:42,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:42,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,375 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:42,376 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:42,376 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:42,376 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:42,376 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,376 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,378 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,378 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:42,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:42,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:42,378 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:42,378 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:42,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:42,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,379 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,379 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 04:54:42,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:42,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:42,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:42,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:42,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:42,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:42,379 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:42,380 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:42,380 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:42,793 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a3e079e96bcc45948687a74beef1dbfc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a3e079e96bcc45948687a74beef1dbfc 2023-02-13 04:54:43,199 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/a08cd153506e4196b8df307c37ea7b88 2023-02-13 04:54:43,204 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/a08cd153506e4196b8df307c37ea7b88 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a08cd153506e4196b8df307c37ea7b88 2023-02-13 04:54:43,208 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a08cd153506e4196b8df307c37ea7b88, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 04:54:43,209 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 829ms, sequenceid=29, compaction requested=true 2023-02-13 04:54:43,209 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:43,209 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:43,209 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:43,209 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:43,209 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,209 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:43,209 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:43,211 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,211 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:43,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:43,211 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,211 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:43,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:43,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:43,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:43,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:43,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a22ebae[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:43,213 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:43,213 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,215 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,215 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:43,215 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:43,215 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:43,215 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,215 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:43,216 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,216 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:43,216 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:43,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:43,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:43,216 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:43,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:43,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:43,218 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:43,218 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:43,218 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:43,218 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,218 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:43,223 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,223 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,223 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:43,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:43,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:43,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,223 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:43,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:43,224 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:43,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,226 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,226 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:43,226 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,226 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:43,226 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:43,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:43,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:43,226 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,227 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,227 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,227 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,226 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:43,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 04:54:43,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:43,227 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:43,227 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:43,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:43,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:43,327 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:43,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:43,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:43,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:43,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,334 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:43,334 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:43,334 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:43,334 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:43,334 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,334 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,336 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:43,336 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:43,336 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:43,336 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,337 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,337 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 04:54:43,337 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:43,337 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:43,337 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:43,337 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:43,337 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:43,337 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:43,337 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:43,337 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:43,338 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:43,749 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036514e56fd99d499f8a60292241143d5a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601036514e56fd99d499f8a60292241143d5a 2023-02-13 04:54:44,155 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/a340c81dbc4c4414bce8fcde83d75115 2023-02-13 04:54:44,159 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/a340c81dbc4c4414bce8fcde83d75115 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a340c81dbc4c4414bce8fcde83d75115 2023-02-13 04:54:44,163 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a340c81dbc4c4414bce8fcde83d75115, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 04:54:44,164 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 826ms, sequenceid=33, compaction requested=true 2023-02-13 04:54:44,164 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:44,164 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:44,167 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,167 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:44,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:44,167 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,167 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:44,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:44,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:44,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:44,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:44,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7583fb7[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:44,169 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:44,169 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,170 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:44,170 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,170 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:44,172 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:44,172 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,172 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:44,172 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:44,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:44,174 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:44,174 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:44,174 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:44,174 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,174 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:44,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:44,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:44,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:44,176 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,177 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,180 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,180 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,180 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:44,180 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:44,180 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,180 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:44,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:44,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:44,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:44,180 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,180 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,180 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,180 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,181 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:44,181 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:44,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:44,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:44,281 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:44,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:44,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:44,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:44,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,287 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:44,287 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:44,287 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:44,287 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:44,288 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,288 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,289 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:44,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:44,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:44,289 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:44,289 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:44,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:44,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,290 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 04:54:44,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:44,290 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:44,291 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:44,291 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:44,291 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:44,291 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:44,291 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:44,291 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:44,291 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:44,705 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090709ad335b896b4ce3a8c3ed747db83e17 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015090709ad335b896b4ce3a8c3ed747db83e17 2023-02-13 04:54:45,116 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/669f5bfece334664902c2c7eb0ed179f 2023-02-13 04:54:45,121 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/669f5bfece334664902c2c7eb0ed179f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/669f5bfece334664902c2c7eb0ed179f 2023-02-13 04:54:45,126 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/669f5bfece334664902c2c7eb0ed179f, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 04:54:45,126 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 835ms, sequenceid=37, compaction requested=true 2023-02-13 04:54:45,127 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:45,127 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:45,127 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:45,127 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:45,127 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,127 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:45,127 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:45,128 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,128 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,129 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:45,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:45,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@543b7efa[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:45,130 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:45,130 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,132 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,132 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:45,132 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,133 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:45,133 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:45,133 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:45,134 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,134 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:45,134 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:45,134 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:45,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:45,137 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:45,137 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:45,137 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:45,137 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,137 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:45,138 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,138 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:45,139 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:45,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:45,139 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:45,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,141 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:45,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:45,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:45,148 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:45,148 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,248 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:45,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:45,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:45,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:45,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,260 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:45,260 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:45,260 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 04:54:45,260 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 04:54:45,261 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,261 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,262 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:45,262 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:45,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:45,262 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:45,262 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:45,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:45,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,263 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,271 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 04:54:45,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 04:54:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 04:54:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:45,272 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:45,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:45,272 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. started... 2023-02-13 04:54:45,273 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e3140d42d553dab37e6b41019f32deeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:45,691 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112095d41731f6044d7cba5b530dade6e5ca to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112095d41731f6044d7cba5b530dade6e5ca 2023-02-13 04:54:46,097 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/62a3efca5fc042a8b396dd200c7cf2b0 2023-02-13 04:54:46,102 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/62a3efca5fc042a8b396dd200c7cf2b0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/62a3efca5fc042a8b396dd200c7cf2b0 2023-02-13 04:54:46,105 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/62a3efca5fc042a8b396dd200c7cf2b0, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 04:54:46,106 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e3140d42d553dab37e6b41019f32deeb in 834ms, sequenceid=41, compaction requested=true 2023-02-13 04:54:46,106 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:46,106 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:46,107 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:46,107 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:46,107 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,107 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 04:54:46,107 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 04:54:46,108 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,108 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:46,109 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:46,109 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:46,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 04:54:46,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32943787[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:46,110 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 04:54:46,110 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,112 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,112 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 04:54:46,112 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 04:54:46,112 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:46,113 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,113 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:46,114 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 04:54:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 04:54:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:46,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 04:54:46,116 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 04:54:46,116 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:46,116 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:46,116 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,116 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:46,117 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,117 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:46,117 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:46,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:46,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:46,118 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,119 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:46,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 04:54:46,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:46,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 04:54:46,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:46,121 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:46,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,121 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:46,122 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:46,222 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:46,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:46,224 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:46,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 04:54:46,226 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 04:54:46,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:46,227 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264686227 2023-02-13 04:54:46,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:54:46,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 04:54:46,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:46,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x0ecf5e97 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:54:46,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f55be19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:54:46,234 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:46,699 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038edeed0ee880477981fcf61ac35ed5c6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038edeed0ee880477981fcf61ac35ed5c6 2023-02-13 04:54:46,700 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:46,716 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:54:46,717 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40488, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:54:46,724 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:54:46,726 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49504, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:54:46,756 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2b522ca723d2451dbdf622acd37e7ba6 first=Optional[r3] last=Optional[r6] 2023-02-13 04:54:46,757 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2b522ca723d2451dbdf622acd37e7ba6}] 2023-02-13 04:54:46,766 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2b522ca723d2451dbdf622acd37e7ba6 for inclusion in e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:46,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 04:54:46,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:46,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:46,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2b522ca723d2451dbdf622acd37e7ba6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ka8fikm1co9olm1i0nujqrf0pmeeq151u0ephep333l15pb159kc183hien6rddv/family1/2b522ca723d2451dbdf622acd37e7ba6 2023-02-13 04:54:46,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ka8fikm1co9olm1i0nujqrf0pmeeq151u0ephep333l15pb159kc183hien6rddv/family1/2b522ca723d2451dbdf622acd37e7ba6 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/20d2a624f9c34e10b482581c034b5e6c_SeqId_44_ 2023-02-13 04:54:46,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ka8fikm1co9olm1i0nujqrf0pmeeq151u0ephep333l15pb159kc183hien6rddv/family1/2b522ca723d2451dbdf622acd37e7ba6 into e3140d42d553dab37e6b41019f32deeb/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/20d2a624f9c34e10b482581c034b5e6c_SeqId_44_ - updating store file list. 2023-02-13 04:54:46,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/20d2a624f9c34e10b482581c034b5e6c_SeqId_44_ into e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:46,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ka8fikm1co9olm1i0nujqrf0pmeeq151u0ephep333l15pb159kc183hien6rddv/family1/2b522ca723d2451dbdf622acd37e7ba6 into e3140d42d553dab37e6b41019f32deeb/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/20d2a624f9c34e10b482581c034b5e6c_SeqId_44_) 2023-02-13 04:54:46,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ka8fikm1co9olm1i0nujqrf0pmeeq151u0ephep333l15pb159kc183hien6rddv/family1/2b522ca723d2451dbdf622acd37e7ba6 2023-02-13 04:54:46,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 04:54:46,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 04:54:46,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): e3140d42d553dab37e6b41019f32deeb/family1 is initiating minor compaction 2023-02-13 04:54:46,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4149cf32; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:46,788 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e3140d42d553dab37e6b41019f32deeb/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:46,788 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/37fd48326d3d4f9399f9881356f03a73, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/901b328ea1d240a5956e880472d06f7c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e6ede13d2fdc4445926058135f848fa0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/369f61f1c1a64a25bb9bf6bd15ee3123, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e833c5f3e1584f61a808372751414e5b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a08cd153506e4196b8df307c37ea7b88, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a340c81dbc4c4414bce8fcde83d75115, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/669f5bfece334664902c2c7eb0ed179f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/62a3efca5fc042a8b396dd200c7cf2b0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/20d2a624f9c34e10b482581c034b5e6c_SeqId_44_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp, totalSize=50.4 K 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 37fd48326d3d4f9399f9881356f03a73, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 901b328ea1d240a5956e880472d06f7c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting e6ede13d2fdc4445926058135f848fa0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 369f61f1c1a64a25bb9bf6bd15ee3123, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting e833c5f3e1584f61a808372751414e5b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting a08cd153506e4196b8df307c37ea7b88, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting a340c81dbc4c4414bce8fcde83d75115, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 669f5bfece334664902c2c7eb0ed179f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 62a3efca5fc042a8b396dd200c7cf2b0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 04:54:46,788 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 20d2a624f9c34e10b482581c034b5e6c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 04:54:46,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:46,791 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:46,794 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc4c60c5463448bf8299ab7d42951fd0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc4c60c5463448bf8299ab7d42951fd0 2023-02-13 04:54:46,796 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123166bb71acb7e941b8b6e5be8fe0e10c12 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123166bb71acb7e941b8b6e5be8fe0e10c12 2023-02-13 04:54:46,798 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a3e079e96bcc45948687a74beef1dbfc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101a3e079e96bcc45948687a74beef1dbfc 2023-02-13 04:54:46,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601036514e56fd99d499f8a60292241143d5a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601036514e56fd99d499f8a60292241143d5a 2023-02-13 04:54:46,800 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-13 04:54:46,800 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 04:54:46,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:46,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:46,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:46,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:46,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:46,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:46,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:46,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:46,876 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): e3140d42d553dab37e6b41019f32deeb#family1#compaction#60 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:54:47,711 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dbb3113eb8554710ba651fd43d9c6bf0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205dbb3113eb8554710ba651fd43d9c6bf0 2023-02-13 04:54:47,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:47,718 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/f6e3e8f8ee904ee3a125bbca11104c09 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/f6e3e8f8ee904ee3a125bbca11104c09 2023-02-13 04:54:47,723 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e3140d42d553dab37e6b41019f32deeb/family1 of e3140d42d553dab37e6b41019f32deeb into f6e3e8f8ee904ee3a125bbca11104c09(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:54:47,723 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:47,723 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676264086787; duration=0sec 2023-02-13 04:54:47,723 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:47,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/37fd48326d3d4f9399f9881356f03a73, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/901b328ea1d240a5956e880472d06f7c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e6ede13d2fdc4445926058135f848fa0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/369f61f1c1a64a25bb9bf6bd15ee3123, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e833c5f3e1584f61a808372751414e5b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a08cd153506e4196b8df307c37ea7b88, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a340c81dbc4c4414bce8fcde83d75115, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/669f5bfece334664902c2c7eb0ed179f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/62a3efca5fc042a8b396dd200c7cf2b0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/20d2a624f9c34e10b482581c034b5e6c_SeqId_44_] to archive 2023-02-13 04:54:47,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:47,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/37fd48326d3d4f9399f9881356f03a73 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/37fd48326d3d4f9399f9881356f03a73 2023-02-13 04:54:47,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/901b328ea1d240a5956e880472d06f7c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/901b328ea1d240a5956e880472d06f7c 2023-02-13 04:54:47,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e6ede13d2fdc4445926058135f848fa0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e6ede13d2fdc4445926058135f848fa0 2023-02-13 04:54:47,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/369f61f1c1a64a25bb9bf6bd15ee3123 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/369f61f1c1a64a25bb9bf6bd15ee3123 2023-02-13 04:54:47,746 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f022026f44241809c5af9564b9eb82d first=Optional[r00] last=Optional[r2] 2023-02-13 04:54:47,747 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f022026f44241809c5af9564b9eb82d}] 2023-02-13 04:54:47,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e833c5f3e1584f61a808372751414e5b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/e833c5f3e1584f61a808372751414e5b 2023-02-13 04:54:47,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a08cd153506e4196b8df307c37ea7b88 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a08cd153506e4196b8df307c37ea7b88 2023-02-13 04:54:47,749 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f022026f44241809c5af9564b9eb82d for inclusion in e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:47,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a340c81dbc4c4414bce8fcde83d75115 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/a340c81dbc4c4414bce8fcde83d75115 2023-02-13 04:54:47,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/669f5bfece334664902c2c7eb0ed179f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/669f5bfece334664902c2c7eb0ed179f 2023-02-13 04:54:47,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 04:54:47,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:47,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:47,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1f022026f44241809c5af9564b9eb82d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mp1loknknkqee9gogquec8gq0rsnf70gha84eddkq7f7qt5fjgnrahb9jh4f5ckk/family1/1f022026f44241809c5af9564b9eb82d 2023-02-13 04:54:47,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/62a3efca5fc042a8b396dd200c7cf2b0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/62a3efca5fc042a8b396dd200c7cf2b0 2023-02-13 04:54:47,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/20d2a624f9c34e10b482581c034b5e6c_SeqId_44_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/20d2a624f9c34e10b482581c034b5e6c_SeqId_44_ 2023-02-13 04:54:47,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mp1loknknkqee9gogquec8gq0rsnf70gha84eddkq7f7qt5fjgnrahb9jh4f5ckk/family1/1f022026f44241809c5af9564b9eb82d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/7c3067226bb8405bb6591eb1c4134eb5_SeqId_47_ 2023-02-13 04:54:47,755 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mp1loknknkqee9gogquec8gq0rsnf70gha84eddkq7f7qt5fjgnrahb9jh4f5ckk/family1/1f022026f44241809c5af9564b9eb82d into e3140d42d553dab37e6b41019f32deeb/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/7c3067226bb8405bb6591eb1c4134eb5_SeqId_47_ - updating store file list. 2023-02-13 04:54:47,759 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/7c3067226bb8405bb6591eb1c4134eb5_SeqId_47_ into e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:47,759 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mp1loknknkqee9gogquec8gq0rsnf70gha84eddkq7f7qt5fjgnrahb9jh4f5ckk/family1/1f022026f44241809c5af9564b9eb82d into e3140d42d553dab37e6b41019f32deeb/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/7c3067226bb8405bb6591eb1c4134eb5_SeqId_47_) 2023-02-13 04:54:47,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__mp1loknknkqee9gogquec8gq0rsnf70gha84eddkq7f7qt5fjgnrahb9jh4f5ckk/family1/1f022026f44241809c5af9564b9eb82d 2023-02-13 04:54:47,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 04:54:47,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 04:54:47,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): e3140d42d553dab37e6b41019f32deeb/family1 is initiating minor compaction (all files) 2023-02-13 04:54:47,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@571e896; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:47,761 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e3140d42d553dab37e6b41019f32deeb/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:47,761 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/efb96a7e56b645bfa797f7513c3a6975, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/f6e3e8f8ee904ee3a125bbca11104c09, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/7c3067226bb8405bb6591eb1c4134eb5_SeqId_47_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp, totalSize=390.1 K 2023-02-13 04:54:47,762 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting efb96a7e56b645bfa797f7513c3a6975, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843565 2023-02-13 04:54:47,762 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting f6e3e8f8ee904ee3a125bbca11104c09, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243565 2023-02-13 04:54:47,763 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 7c3067226bb8405bb6591eb1c4134eb5_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878843565 2023-02-13 04:54:47,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:47,764 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:47,765 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511302659af6fac5a4359aeeca5deadad3783 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511302659af6fac5a4359aeeca5deadad3783 2023-02-13 04:54:47,767 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201dc4ba02a13ad49b88c59c474cb2a8c99 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201dc4ba02a13ad49b88c59c474cb2a8c99 2023-02-13 04:54:47,768 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057be6dea39b49414ca88ae0f83b6c9372 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512057be6dea39b49414ca88ae0f83b6c9372 2023-02-13 04:54:47,768 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-13 04:54:47,768 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 04:54:47,769 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:47,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:47,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:47,770 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 04:54:47,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.5460 sec 2023-02-13 04:54:47,779 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): e3140d42d553dab37e6b41019f32deeb#family1#compaction#61 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:54:47,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 04:54:47,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:48,261 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 04:54:48,262 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 04:54:48,262 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 04:54:48,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 04:54:48,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, REOPEN/MOVE}] 2023-02-13 04:54:48,267 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, REOPEN/MOVE 2023-02-13 04:54:48,268 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:48,268 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264088268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264088268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264088268"}]},"ts":"1676264088268"} 2023-02-13 04:54:48,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:48,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:48,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e3140d42d553dab37e6b41019f32deeb, disabling compactions & flushes 2023-02-13 04:54:48,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:48,998 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/.tmp/family1/754bd244eb3040d596adb1729e5fc1a4 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/754bd244eb3040d596adb1729e5fc1a4 2023-02-13 04:54:49,002 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e3140d42d553dab37e6b41019f32deeb/family1 of e3140d42d553dab37e6b41019f32deeb into 754bd244eb3040d596adb1729e5fc1a4(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:54:49,002 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:49,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:49,002 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1676264087761; duration=1sec 2023-02-13 04:54:49,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:49,003 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:54:49,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. after waiting 0 ms 2023-02-13 04:54:49,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:49,004 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/efb96a7e56b645bfa797f7513c3a6975, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/f6e3e8f8ee904ee3a125bbca11104c09, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/7c3067226bb8405bb6591eb1c4134eb5_SeqId_47_] to archive 2023-02-13 04:54:49,005 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:49,007 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/efb96a7e56b645bfa797f7513c3a6975 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/efb96a7e56b645bfa797f7513c3a6975 2023-02-13 04:54:49,008 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/f6e3e8f8ee904ee3a125bbca11104c09 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/f6e3e8f8ee904ee3a125bbca11104c09 2023-02-13 04:54:49,009 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/7c3067226bb8405bb6591eb1c4134eb5_SeqId_47_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/7c3067226bb8405bb6591eb1c4134eb5_SeqId_47_ 2023-02-13 04:54:49,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 04:54:49,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:49,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e3140d42d553dab37e6b41019f32deeb: Waiting for close lock at 1676264088422Running coprocessor pre-close hooks at 1676264088422Disabling compacts and flushes for region at 1676264088422Disabling writes for close at 1676264089003 (+581 ms)Writing region close event to WAL at 1676264089011 (+8 ms)Running coprocessor post-close hooks at 1676264089014 (+3 ms)Closed at 1676264089014 2023-02-13 04:54:49,014 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: e3140d42d553dab37e6b41019f32deeb to self. 2023-02-13 04:54:49,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:49,016 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=CLOSED 2023-02-13 04:54:49,016 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264089016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264089016"}]},"ts":"1676264089016"} 2023-02-13 04:54:49,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-13 04:54:49,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660 in 747 msec 2023-02-13 04:54:49,019 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=true 2023-02-13 04:54:49,169 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:49,169 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264089169"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264089169"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264089169"}]},"ts":"1676264089169"} 2023-02-13 04:54:49,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:49,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:49,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e3140d42d553dab37e6b41019f32deeb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:54:49,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:49,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:49,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:49,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:49,327 INFO [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:49,328 DEBUG [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:49,328 DEBUG [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:49,328 INFO [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3140d42d553dab37e6b41019f32deeb columnFamilyName family1 2023-02-13 04:54:49,333 DEBUG [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/754bd244eb3040d596adb1729e5fc1a4 2023-02-13 04:54:49,333 INFO [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] regionserver.HStore(310): Store=e3140d42d553dab37e6b41019f32deeb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:49,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:49,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:49,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:49,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e3140d42d553dab37e6b41019f32deeb; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71181450, jitterRate=0.06068626046180725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:54:49,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e3140d42d553dab37e6b41019f32deeb: Running coprocessor pre-open hook at 1676264089326Writing region info on filesystem at 1676264089326Initializing all the Stores at 1676264089326Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676264089326Cleaning up temporary data from old regions at 1676264089335 (+9 ms)Cleaning up detritus from prior splits at 1676264089335Running coprocessor post-open hooks at 1676264089337 (+2 ms)Region opened successfully at 1676264089337 2023-02-13 04:54:49,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb., pid=47, masterSystemTime=1676264089322 2023-02-13 04:54:49,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:49,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:49,340 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:49,340 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264089340"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264089340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264089340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264089340"}]},"ts":"1676264089340"} 2023-02-13 04:54:49,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-13 04:54:49,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660 in 170 msec 2023-02-13 04:54:49,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-13 04:54:49,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, REOPEN/MOVE in 1.0760 sec 2023-02-13 04:54:49,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-13 04:54:49,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0800 sec 2023-02-13 04:54:49,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4950 sec 2023-02-13 04:54:49,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-13 04:54:49,349 INFO [Listener at localhost/37751] compactions.TestMobCompactor(278): alter status finished 2023-02-13 04:54:49,350 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:49,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 04:54:49,351 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 04:54:49,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:49,352 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264689352 2023-02-13 04:54:49,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:54:49,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 04:54:49,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:49,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x024dd8de to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:54:49,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30da0bf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:54:49,360 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:49,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:49,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:49,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:49,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:50,189 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128564be519e1b4490d831afec084eb77c5 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128564be519e1b4490d831afec084eb77c5 2023-02-13 04:54:50,190 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:50,203 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:54:50,204 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:54:50,209 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:54:50,211 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49518, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:54:50,219 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0ab76a311a244619908ee772bce4a0a5 first=Optional[r05] last=Optional[r8] 2023-02-13 04:54:50,220 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0ab76a311a244619908ee772bce4a0a5}] 2023-02-13 04:54:50,224 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0ab76a311a244619908ee772bce4a0a5 for inclusion in e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:50,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 04:54:50,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:54:50,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for e3140d42d553dab37e6b41019f32deeb: 2023-02-13 04:54:50,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0ab76a311a244619908ee772bce4a0a5 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5pircffp8gp69dn7rmauf08ieirssn3inl5neaubokbe6b7n69q13dqpp69ikrmg/family1/0ab76a311a244619908ee772bce4a0a5 2023-02-13 04:54:50,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5pircffp8gp69dn7rmauf08ieirssn3inl5neaubokbe6b7n69q13dqpp69ikrmg/family1/0ab76a311a244619908ee772bce4a0a5 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/89785d41105b459dbb1cb17becadc3b2_SeqId_53_ 2023-02-13 04:54:50,231 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5pircffp8gp69dn7rmauf08ieirssn3inl5neaubokbe6b7n69q13dqpp69ikrmg/family1/0ab76a311a244619908ee772bce4a0a5 into e3140d42d553dab37e6b41019f32deeb/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/89785d41105b459dbb1cb17becadc3b2_SeqId_53_ - updating store file list. 2023-02-13 04:54:50,234 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/89785d41105b459dbb1cb17becadc3b2_SeqId_53_ into e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:50,234 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5pircffp8gp69dn7rmauf08ieirssn3inl5neaubokbe6b7n69q13dqpp69ikrmg/family1/0ab76a311a244619908ee772bce4a0a5 into e3140d42d553dab37e6b41019f32deeb/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/89785d41105b459dbb1cb17becadc3b2_SeqId_53_) 2023-02-13 04:54:50,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5pircffp8gp69dn7rmauf08ieirssn3inl5neaubokbe6b7n69q13dqpp69ikrmg/family1/0ab76a311a244619908ee772bce4a0a5 2023-02-13 04:54:50,236 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:50,236 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:54:50,237 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112095d41731f6044d7cba5b530dade6e5ca to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112095d41731f6044d7cba5b530dade6e5ca 2023-02-13 04:54:50,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287417041eaeca4fc08f24079a0f8f7ce7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287417041eaeca4fc08f24079a0f8f7ce7 2023-02-13 04:54:50,238 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-13 04:54:50,238 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 04:54:50,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:50,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:50,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:50,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:50,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:50,240 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 04:54:50,241 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 890 msec 2023-02-13 04:54:50,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 04:54:50,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:50,708 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 04:54:50,709 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 04:54:50,709 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 04:54:50,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 04:54:50,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, REOPEN/MOVE}] 2023-02-13 04:54:50,715 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, REOPEN/MOVE 2023-02-13 04:54:50,716 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:50,716 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264090716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264090716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264090716"}]},"ts":"1676264090716"} 2023-02-13 04:54:50,717 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:50,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:50,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e3140d42d553dab37e6b41019f32deeb, disabling compactions & flushes 2023-02-13 04:54:50,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:50,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:50,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. after waiting 0 ms 2023-02-13 04:54:50,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:50,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 04:54:50,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:50,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e3140d42d553dab37e6b41019f32deeb: Waiting for close lock at 1676264090869Running coprocessor pre-close hooks at 1676264090869Disabling compacts and flushes for region at 1676264090869Disabling writes for close at 1676264090869Writing region close event to WAL at 1676264090872 (+3 ms)Running coprocessor post-close hooks at 1676264090875 (+3 ms)Closed at 1676264090876 (+1 ms) 2023-02-13 04:54:50,876 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: e3140d42d553dab37e6b41019f32deeb to self. 2023-02-13 04:54:50,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:50,878 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=CLOSED 2023-02-13 04:54:50,878 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264090878"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264090878"}]},"ts":"1676264090878"} 2023-02-13 04:54:50,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-13 04:54:50,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660 in 162 msec 2023-02-13 04:54:50,881 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=true 2023-02-13 04:54:51,031 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:51,031 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264091031"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264091031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264091031"}]},"ts":"1676264091031"} 2023-02-13 04:54:51,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:51,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:51,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e3140d42d553dab37e6b41019f32deeb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:54:51,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:51,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:51,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:51,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:51,189 INFO [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:51,190 DEBUG [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:51,190 DEBUG [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1 2023-02-13 04:54:51,190 INFO [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3140d42d553dab37e6b41019f32deeb columnFamilyName family1 2023-02-13 04:54:51,195 DEBUG [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/754bd244eb3040d596adb1729e5fc1a4 2023-02-13 04:54:51,198 DEBUG [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/family1/89785d41105b459dbb1cb17becadc3b2_SeqId_53_ 2023-02-13 04:54:51,198 INFO [StoreOpener-e3140d42d553dab37e6b41019f32deeb-1] regionserver.HStore(310): Store=e3140d42d553dab37e6b41019f32deeb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:51,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:51,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:51,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:54:51,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e3140d42d553dab37e6b41019f32deeb; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60649314, jitterRate=-0.09625479578971863}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:54:51,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e3140d42d553dab37e6b41019f32deeb: Running coprocessor pre-open hook at 1676264091188Writing region info on filesystem at 1676264091188Initializing all the Stores at 1676264091188Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676264091188Cleaning up temporary data from old regions at 1676264091201 (+13 ms)Cleaning up detritus from prior splits at 1676264091201Running coprocessor post-open hooks at 1676264091204 (+3 ms)Region opened successfully at 1676264091204 2023-02-13 04:54:51,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb., pid=53, masterSystemTime=1676264091184 2023-02-13 04:54:51,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:51,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:54:51,207 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e3140d42d553dab37e6b41019f32deeb, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:51,207 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676264091207"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264091207"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264091207"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264091207"}]},"ts":"1676264091207"} 2023-02-13 04:54:51,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-13 04:54:51,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure e3140d42d553dab37e6b41019f32deeb, server=jenkins-hbase4.apache.org,37513,1676264019660 in 175 msec 2023-02-13 04:54:51,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-13 04:54:51,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e3140d42d553dab37e6b41019f32deeb, REOPEN/MOVE in 496 msec 2023-02-13 04:54:51,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-13 04:54:51,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 501 msec 2023-02-13 04:54:51,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 916 msec 2023-02-13 04:54:51,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-13 04:54:51,216 INFO [Listener at localhost/37751] compactions.TestMobCompactor(278): alter status finished 2023-02-13 04:54:51,217 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 04:54:51,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 04:54:51,219 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 04:54:51,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:51,219 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264691219 2023-02-13 04:54:51,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:54:51,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 04:54:51,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:51,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x4a5022b7 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:54:51,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a3575ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:54:51,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:51,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:51,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:51,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:51,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:51,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:51,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:51,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 04:54:51,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 04:54:51,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:54:51,226 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 04:54:51,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 8 msec 2023-02-13 04:54:51,287 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=242 (was 263), OpenFileDescriptor=616 (was 636), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 264), ProcessCount=168 (was 168), AvailableMemoryMB=3752 (was 3981) 2023-02-13 04:54:51,297 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=242, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=249, ProcessCount=168, AvailableMemoryMB=3752 2023-02-13 04:54:51,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 04:54:51,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:51,302 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:54:51,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-13 04:54:51,303 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:54:51,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 04:54:51,304 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff 2023-02-13 04:54:51,304 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff empty. 2023-02-13 04:54:51,305 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff 2023-02-13 04:54:51,305 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-13 04:54:51,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 04:54:51,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 04:54:51,713 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 04:54:51,714 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => df6dd8289209e33a66ab42a45700acff, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:54:51,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 04:54:52,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:52,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing df6dd8289209e33a66ab42a45700acff, disabling compactions & flushes 2023-02-13 04:54:52,132 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:52,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:52,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. after waiting 0 ms 2023-02-13 04:54:52,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:52,132 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:52,132 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for df6dd8289209e33a66ab42a45700acff: Waiting for close lock at 1676264092132Disabling compacts and flushes for region at 1676264092132Disabling writes for close at 1676264092132Writing region close event to WAL at 1676264092132Closed at 1676264092132 2023-02-13 04:54:52,135 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:54:52,136 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264092136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264092136"}]},"ts":"1676264092136"} 2023-02-13 04:54:52,137 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:54:52,138 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:54:52,138 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264092138"}]},"ts":"1676264092138"} 2023-02-13 04:54:52,140 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-13 04:54:52,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, ASSIGN}] 2023-02-13 04:54:52,144 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, ASSIGN 2023-02-13 04:54:52,145 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:54:52,296 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:52,296 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264092295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264092295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264092295"}]},"ts":"1676264092295"} 2023-02-13 04:54:52,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:54:52,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 04:54:52,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:52,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => df6dd8289209e33a66ab42a45700acff, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:54:52,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily df6dd8289209e33a66ab42a45700acff 2023-02-13 04:54:52,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:54:52,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:54:52,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:54:52,453 INFO [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region df6dd8289209e33a66ab42a45700acff 2023-02-13 04:54:52,454 DEBUG [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:54:52,454 DEBUG [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:54:52,455 INFO [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df6dd8289209e33a66ab42a45700acff columnFamilyName family1 2023-02-13 04:54:52,456 INFO [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] regionserver.HStore(310): Store=df6dd8289209e33a66ab42a45700acff/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:54:52,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff 2023-02-13 04:54:52,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff 2023-02-13 04:54:52,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:54:52,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:54:52,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened df6dd8289209e33a66ab42a45700acff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67175201, jitterRate=9.88498330116272E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:54:52,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for df6dd8289209e33a66ab42a45700acff: Running coprocessor pre-open hook at 1676264092452Writing region info on filesystem at 1676264092452Initializing all the Stores at 1676264092453 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676264092453Cleaning up temporary data from old regions at 1676264092457 (+4 ms)Cleaning up detritus from prior splits at 1676264092458 (+1 ms)Running coprocessor post-open hooks at 1676264092463 (+5 ms)Region opened successfully at 1676264092463 2023-02-13 04:54:52,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff., pid=57, masterSystemTime=1676264092449 2023-02-13 04:54:52,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:52,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:52,465 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:52,465 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264092465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264092465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264092465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264092465"}]},"ts":"1676264092465"} 2023-02-13 04:54:52,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-13 04:54:52,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660 in 169 msec 2023-02-13 04:54:52,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-13 04:54:52,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, ASSIGN in 325 msec 2023-02-13 04:54:52,469 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:54:52,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264092469"}]},"ts":"1676264092469"} 2023-02-13 04:54:52,470 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-13 04:54:52,472 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:54:52,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1720 sec 2023-02-13 04:54:53,388 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:53,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 04:54:53,409 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-13 04:54:53,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:53,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:53,426 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:53,426 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:53,426 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:54:53,426 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:54:53,427 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:53,427 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:53,429 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:53,429 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:53,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:53,429 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:53,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:53,429 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:53,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:53,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:53,430 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:53,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:53,430 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:54:53,430 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:53,430 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:54:53,432 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:53,432 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:53,432 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:53,432 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:54:53,433 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 04:54:53,851 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113049421d1f9ab044e68e5c34cc2c2f9d58 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113049421d1f9ab044e68e5c34cc2c2f9d58 2023-02-13 04:54:54,256 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/4c89b0bdbfad4da898ffe3c9fd7d59ec 2023-02-13 04:54:54,260 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/4c89b0bdbfad4da898ffe3c9fd7d59ec as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/4c89b0bdbfad4da898ffe3c9fd7d59ec 2023-02-13 04:54:54,264 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/4c89b0bdbfad4da898ffe3c9fd7d59ec, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-13 04:54:54,265 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 832ms, sequenceid=5, compaction requested=false 2023-02-13 04:54:54,266 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:54:54,266 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:54,266 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:54,266 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:54,266 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,266 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:54:54,266 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:54:54,268 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,268 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:54,268 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,268 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f16c5e0[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:54,270 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:54:54,270 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,271 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,271 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:54:54,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:54:54,272 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:54,272 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,272 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:54,273 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:54:54,273 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,273 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:54,273 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:54:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:54,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:54,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:54,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:54:54,276 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:54:54,276 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:54,276 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:54,276 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,276 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:54,281 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,281 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:54,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,281 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:54,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:54,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:54,282 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:54,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,283 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:54,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,288 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,288 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,289 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:54,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 04:54:54,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:54,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:54,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:54,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:54,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:54,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:54,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,289 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,289 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:54,289 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:54,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:54,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:54,389 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:54,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:54,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:54,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:54,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,396 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:54,396 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:54,396 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:54:54,396 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:54:54,396 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,396 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,397 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:54,397 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:54,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:54,398 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:54,398 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:54,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:54,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,398 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,398 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 04:54:54,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:54:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:54:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:54,399 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:54,399 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:54,399 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:54:54,399 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 04:54:54,553 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:54:54,812 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280d8b4583aec340e1ab2a5c7e17fd03f7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280d8b4583aec340e1ab2a5c7e17fd03f7 2023-02-13 04:54:55,218 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/0c4d216b3ccd435c9955ae32438996d4 2023-02-13 04:54:55,222 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/0c4d216b3ccd435c9955ae32438996d4 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0c4d216b3ccd435c9955ae32438996d4 2023-02-13 04:54:55,226 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0c4d216b3ccd435c9955ae32438996d4, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 04:54:55,227 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 828ms, sequenceid=9, compaction requested=false 2023-02-13 04:54:55,227 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:54:55,227 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:54:55,227 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:54:55,229 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,229 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:55,229 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,229 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:55,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:54:55,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f5ee32[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:55,231 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:54:55,231 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,232 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,232 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:54:55,232 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:54:55,232 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,232 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:55,232 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:55,235 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,235 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:54:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:55,235 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:55,235 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:54:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:55,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:54:55,237 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:54:55,237 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:55,237 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:55,237 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,237 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:55,239 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,239 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,239 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:55,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:55,239 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,241 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:55,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,246 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,246 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,246 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,246 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,246 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:55,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 04:54:55,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:55,246 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:55,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:55,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:55,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:55,246 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:55,246 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,247 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,247 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:55,247 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:55,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:55,247 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:55,347 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:55,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:55,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:55,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:55,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,353 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:55,353 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:55,353 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:54:55,353 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:54:55,354 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,354 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,355 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:55,355 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:55,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:55,355 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:55,355 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:55,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:55,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,356 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,356 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 04:54:55,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:55,356 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:54:55,357 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:55,357 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:54:55,357 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:55,357 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:55,357 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:55,357 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:54:55,357 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:55,769 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015000f0e2e0c94fa295812e90319f2b5e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512015000f0e2e0c94fa295812e90319f2b5e 2023-02-13 04:54:56,174 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/e5787ad877734af18ac55e156cc02b3e 2023-02-13 04:54:56,179 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/e5787ad877734af18ac55e156cc02b3e as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e5787ad877734af18ac55e156cc02b3e 2023-02-13 04:54:56,183 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e5787ad877734af18ac55e156cc02b3e, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 04:54:56,183 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 826ms, sequenceid=13, compaction requested=true 2023-02-13 04:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:54:56,183 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:56,184 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:56,184 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:56,184 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,184 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:54:56,184 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:54:56,185 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,185 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:56,185 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,186 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:56,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:54:56,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b68d58[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:56,187 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:54:56,187 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,188 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:54:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:54:56,188 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:56,188 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,188 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:56,189 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,189 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:54:56,189 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:56,189 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:54:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:56,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:54:56,191 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:54:56,191 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:56,191 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:56,191 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,191 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:56,193 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,193 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:56,193 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:56,194 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,195 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,197 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:56,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:56,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:56,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:56,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:56,197 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:56,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:56,198 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,297 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:56,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:56,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:56,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:56,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,304 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:56,304 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:56,304 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:54:56,304 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:54:56,304 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,304 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,306 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:56,306 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:56,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:56,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,306 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,306 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:56,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:56,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,307 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,308 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 04:54:56,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:54:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:54:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:56,308 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:56,308 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:56,308 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:54:56,309 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:56,721 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205737835bf59c0441c9afb1402c1927994 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205737835bf59c0441c9afb1402c1927994 2023-02-13 04:54:56,732 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/2d2a4bda0f944cfbbd58c68e25ac5745 2023-02-13 04:54:56,736 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/2d2a4bda0f944cfbbd58c68e25ac5745 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/2d2a4bda0f944cfbbd58c68e25ac5745 2023-02-13 04:54:56,740 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/2d2a4bda0f944cfbbd58c68e25ac5745, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 04:54:56,741 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 432ms, sequenceid=17, compaction requested=true 2023-02-13 04:54:56,741 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:54:56,741 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:56,741 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:54:56,742 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:54:56,743 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,743 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:56,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:56,744 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,744 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:56,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:56,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:56,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:56,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:54:56,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@158dba06[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:56,753 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:54:56,753 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,758 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,759 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:54:56,759 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,759 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:56,759 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:54:56,759 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:56,761 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,761 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:54:56,761 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:56,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:56,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:56,761 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:54:56,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:56,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:56,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:54:56,764 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:54:56,764 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:56,764 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:56,764 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,764 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:56,766 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,766 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:56,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,767 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:56,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:56,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:56,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:56,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:56,767 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:56,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,769 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:56,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:56,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:56,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:56,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:56,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:56,771 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:56,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:56,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 04:54:56,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:56,771 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:56,872 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:56,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:56,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:56,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:56,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,878 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:56,878 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:56,878 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:54:56,878 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:54:56,878 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,878 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,879 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,880 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:56,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:56,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:56,880 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:56,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,880 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:56,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:56,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,881 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,881 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 04:54:56,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:54:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:54:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:56,881 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:56,881 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:54:56,881 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:57,302 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e28e7ede77204528bb5e5b2101f491eb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e28e7ede77204528bb5e5b2101f491eb 2023-02-13 04:54:57,710 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/adfbcd8be97341b3b02e5ceb50b87d2e 2023-02-13 04:54:57,715 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/adfbcd8be97341b3b02e5ceb50b87d2e as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/adfbcd8be97341b3b02e5ceb50b87d2e 2023-02-13 04:54:57,719 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/adfbcd8be97341b3b02e5ceb50b87d2e, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 04:54:57,720 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 839ms, sequenceid=21, compaction requested=true 2023-02-13 04:54:57,720 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:54:57,720 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:54:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:54:57,722 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,722 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:57,722 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,722 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:57,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:54:57,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c4d5492[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:57,724 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:54:57,724 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,726 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,726 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:54:57,726 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:54:57,726 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:57,726 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,726 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:57,728 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:54:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:54:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:57,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:54:57,730 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:54:57,731 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:57,731 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:57,731 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,731 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:57,732 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,732 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:57,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:57,732 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:57,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:57,733 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:57,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,734 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:57,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,738 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:57,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,738 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:57,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:57,838 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:57,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:57,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:57,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:57,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,845 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:57,845 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:57,845 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:54:57,845 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:54:57,845 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,846 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,847 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,847 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:57,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:57,847 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,847 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:57,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,848 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,849 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 04:54:57,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:54:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:54:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:57,849 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:57,849 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:57,849 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:54:57,849 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:57,873 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b2cacf92eb2d4912a2b767ed3023e58c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b2cacf92eb2d4912a2b767ed3023e58c 2023-02-13 04:54:57,894 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/8bcdfde36f754c6db1a4f0828726b274 2023-02-13 04:54:57,899 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/8bcdfde36f754c6db1a4f0828726b274 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/8bcdfde36f754c6db1a4f0828726b274 2023-02-13 04:54:57,904 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/8bcdfde36f754c6db1a4f0828726b274, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 04:54:57,905 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 56ms, sequenceid=25, compaction requested=true 2023-02-13 04:54:57,905 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:54:57,905 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:57,905 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:57,905 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:57,905 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,905 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:54:57,905 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:54:57,907 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,907 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:57,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:57,907 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,907 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:57,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:57,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:57,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:57,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:54:57,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a6fa357[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:57,909 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:54:57,909 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,911 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,911 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:54:57,911 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,911 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:57,911 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:54:57,911 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:57,914 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:54:57,914 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:57,914 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,914 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:54:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:57,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:57,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:57,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:57,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:54:57,917 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:54:57,917 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:57,917 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:57,917 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,917 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:57,919 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,919 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,919 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:57,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:57,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:57,919 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:57,920 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,926 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:57,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:57,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:57,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:57,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:57,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:57,926 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:57,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:57,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:58,026 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:58,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:58,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:58,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:58,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,034 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:58,034 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:58,034 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:54:58,034 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:54:58,035 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,035 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,039 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:58,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:58,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:58,039 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,040 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,040 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:58,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:58,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,040 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,041 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 04:54:58,041 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,041 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:54:58,041 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:58,041 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:54:58,056 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:58,056 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:58,056 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:54:58,056 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:58,056 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:58,075 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101db97bfd0262d4f57be80a7ba08086804 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101db97bfd0262d4f57be80a7ba08086804 2023-02-13 04:54:58,081 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/91f5df5d6471413fb124677b62029ae7 2023-02-13 04:54:58,087 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/91f5df5d6471413fb124677b62029ae7 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/91f5df5d6471413fb124677b62029ae7 2023-02-13 04:54:58,091 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/91f5df5d6471413fb124677b62029ae7, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 04:54:58,092 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 36ms, sequenceid=29, compaction requested=true 2023-02-13 04:54:58,092 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:54:58,092 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:58,092 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:58,092 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:58,092 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,092 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:54:58,092 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:54:58,094 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,094 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:58,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:58,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:58,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:58,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:54:58,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78812b0f[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:58,096 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:54:58,097 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,098 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,098 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:54:58,098 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:54:58,098 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,098 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:58,098 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:58,100 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:54:58,100 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:58,100 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,100 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:54:58,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:58,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:58,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:58,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:54:58,103 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:54:58,103 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:58,103 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:58,103 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,103 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:58,106 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,106 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:58,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,106 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:58,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:58,106 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,108 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,111 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,111 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:58,111 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,111 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:58,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 04:54:58,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:58,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:58,111 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:58,111 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:58,112 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,112 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,112 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,112 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:58,112 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,112 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:58,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:58,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:58,212 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:58,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:58,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:58,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:58,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,220 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:58,220 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:58,220 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:54:58,220 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:54:58,224 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,224 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,225 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,226 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:58,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:58,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:58,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,226 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:58,226 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:58,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:58,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 04:54:58,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:58,228 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:54:58,228 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:58,228 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:54:58,228 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:58,228 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:58,228 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:58,228 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:54:58,228 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:58,655 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103133b23d11c3240c8bd057cddf57b3ee3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103133b23d11c3240c8bd057cddf57b3ee3 2023-02-13 04:54:59,061 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/0940c5eaeddb445bb5ebcf42877f9bf7 2023-02-13 04:54:59,067 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/0940c5eaeddb445bb5ebcf42877f9bf7 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0940c5eaeddb445bb5ebcf42877f9bf7 2023-02-13 04:54:59,072 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0940c5eaeddb445bb5ebcf42877f9bf7, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 04:54:59,072 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 844ms, sequenceid=33, compaction requested=true 2023-02-13 04:54:59,072 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:54:59,072 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:59,073 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:54:59,073 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:54:59,073 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,073 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:54:59,073 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:54:59,074 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,074 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:59,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:59,075 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:59,075 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:54:59,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:59,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:59,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:54:59,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24e393[Count = 0] remaining members to acquire global barrier 2023-02-13 04:54:59,076 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:54:59,076 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,078 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,078 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:54:59,078 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:54:59,078 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:54:59,078 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,078 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:54:59,079 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:54:59,079 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,079 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:59,079 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:54:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:54:59,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:54:59,082 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:54:59,082 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:54:59,082 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:54:59,082 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,082 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:54:59,084 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,084 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,084 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:54:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:54:59,085 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:54:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,086 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:54:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,088 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,088 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:59,088 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:59,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 04:54:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:59,088 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:54:59,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:59,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:54:59,088 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,088 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:54:59,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:54:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:54:59,088 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,089 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,089 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:54:59,089 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,089 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:54:59,089 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,189 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:54:59,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:54:59,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:54:59,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 04:54:59,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,204 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:54:59,204 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:59,204 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:54:59,204 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:54:59,205 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,205 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,206 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:54:59,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:54:59,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:54:59,206 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,207 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:54:59,207 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:54:59,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:54:59,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,207 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,212 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 04:54:59,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:54:59,212 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:54:59,212 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:54:59,212 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:54:59,213 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:54:59,213 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:54:59,213 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:54:59,214 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:54:59,214 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:54:59,642 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077b37db655aa349a09c9d50c536dadad6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509077b37db655aa349a09c9d50c536dadad6 2023-02-13 04:55:00,048 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/d47351a8a3754066a21437e32de9dd39 2023-02-13 04:55:00,052 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/d47351a8a3754066a21437e32de9dd39 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/d47351a8a3754066a21437e32de9dd39 2023-02-13 04:55:00,056 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/d47351a8a3754066a21437e32de9dd39, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 04:55:00,057 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 843ms, sequenceid=37, compaction requested=true 2023-02-13 04:55:00,057 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:55:00,057 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:00,057 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:55:00,057 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:55:00,057 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,057 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:55:00,057 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:55:00,060 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,060 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:00,060 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,060 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:00,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:00,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:55:00,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cbcec1[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:00,061 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:55:00,062 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,063 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,063 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:55:00,063 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:55:00,063 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:00,063 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,063 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:55:00,065 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:00,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:00,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:00,065 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:55:00,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:00,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:00,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:00,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:00,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:55:00,067 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:55:00,067 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:00,067 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:00,067 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,067 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:00,069 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,069 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:00,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:00,069 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:00,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:00,069 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:00,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:00,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:00,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,070 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:00,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,073 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,073 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,073 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,074 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:00,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 04:55:00,073 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:00,074 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:55:00,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:00,074 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:00,074 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:00,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:00,074 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:00,074 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:00,074 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:00,074 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:00,174 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:00,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:00,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:00,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 04:55:00,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,180 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:55:00,180 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:00,180 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 04:55:00,180 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 04:55:00,181 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,181 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,182 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,182 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:00,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:00,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:00,182 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:00,182 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:00,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:00,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,183 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,183 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 04:55:00,183 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:00,183 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 04:55:00,183 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:00,183 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 04:55:00,184 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:55:00,184 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:00,184 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:00,184 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. started... 2023-02-13 04:55:00,184 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6dd8289209e33a66ab42a45700acff 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:55:00,596 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511209c619a7270c145829ee89c8ab0237197 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511209c619a7270c145829ee89c8ab0237197 2023-02-13 04:55:01,001 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/220dcd9e927c4a3db24f4e25f1156e4d 2023-02-13 04:55:01,005 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/220dcd9e927c4a3db24f4e25f1156e4d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/220dcd9e927c4a3db24f4e25f1156e4d 2023-02-13 04:55:01,009 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/220dcd9e927c4a3db24f4e25f1156e4d, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 04:55:01,010 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6dd8289209e33a66ab42a45700acff in 826ms, sequenceid=41, compaction requested=true 2023-02-13 04:55:01,010 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:55:01,010 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:01,010 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:55:01,010 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:55:01,010 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,010 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 04:55:01,010 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 04:55:01,012 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,012 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:01,012 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:01,012 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:01,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 04:55:01,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3109a054[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:01,014 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 04:55:01,014 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,015 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,015 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 04:55:01,015 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 04:55:01,015 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,015 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:01,015 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:01,016 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,016 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 04:55:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:01,016 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:01,016 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 04:55:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:01,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:01,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 04:55:01,018 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 04:55:01,018 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:01,018 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:01,018 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,018 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:01,021 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,021 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,021 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:01,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:01,021 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,022 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,024 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,024 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:01,024 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 04:55:01,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:01,025 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,024 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:01,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:01,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:01,024 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:01,025 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:01,025 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:01,025 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:01,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:01,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:01,025 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,025 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,025 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,125 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:01,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:01,127 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:01,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 04:55:01,129 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 04:55:01,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:55:01,130 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264701130 2023-02-13 04:55:01,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:55:01,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 04:55:01,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:01,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x7f11d8b8 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:55:01,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7504d3a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:55:01,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:01,973 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f81bd8a4ec4e4bf1b390c82ee829f0c7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103f81bd8a4ec4e4bf1b390c82ee829f0c7 2023-02-13 04:55:01,974 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:01,986 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:55:01,987 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:55:01,995 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:55:01,996 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:55:02,004 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8679d97fdd54dd3a45471d5d27af5ed first=Optional[r3] last=Optional[r6] 2023-02-13 04:55:02,004 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8679d97fdd54dd3a45471d5d27af5ed}] 2023-02-13 04:55:02,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8679d97fdd54dd3a45471d5d27af5ed for inclusion in df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:02,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 04:55:02,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:55:02,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:55:02,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8679d97fdd54dd3a45471d5d27af5ed to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fp4h7vtnr5mnrputlgpb0b7vqch7spcedrk757pl7kie64nud8alod5juo2bpikq/family1/a8679d97fdd54dd3a45471d5d27af5ed 2023-02-13 04:55:02,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fp4h7vtnr5mnrputlgpb0b7vqch7spcedrk757pl7kie64nud8alod5juo2bpikq/family1/a8679d97fdd54dd3a45471d5d27af5ed as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e1e25fda5f244f1cbee1a96f2f036307_SeqId_44_ 2023-02-13 04:55:02,014 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fp4h7vtnr5mnrputlgpb0b7vqch7spcedrk757pl7kie64nud8alod5juo2bpikq/family1/a8679d97fdd54dd3a45471d5d27af5ed into df6dd8289209e33a66ab42a45700acff/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e1e25fda5f244f1cbee1a96f2f036307_SeqId_44_ - updating store file list. 2023-02-13 04:55:02,018 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e1e25fda5f244f1cbee1a96f2f036307_SeqId_44_ into df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:02,018 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fp4h7vtnr5mnrputlgpb0b7vqch7spcedrk757pl7kie64nud8alod5juo2bpikq/family1/a8679d97fdd54dd3a45471d5d27af5ed into df6dd8289209e33a66ab42a45700acff/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e1e25fda5f244f1cbee1a96f2f036307_SeqId_44_) 2023-02-13 04:55:02,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fp4h7vtnr5mnrputlgpb0b7vqch7spcedrk757pl7kie64nud8alod5juo2bpikq/family1/a8679d97fdd54dd3a45471d5d27af5ed 2023-02-13 04:55:02,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 04:55:02,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 04:55:02,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): df6dd8289209e33a66ab42a45700acff/family1 is initiating minor compaction 2023-02-13 04:55:02,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2c7a0948; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:55:02,021 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of df6dd8289209e33a66ab42a45700acff/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:02,021 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0c4d216b3ccd435c9955ae32438996d4, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e5787ad877734af18ac55e156cc02b3e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/2d2a4bda0f944cfbbd58c68e25ac5745, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/adfbcd8be97341b3b02e5ceb50b87d2e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/8bcdfde36f754c6db1a4f0828726b274, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/91f5df5d6471413fb124677b62029ae7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0940c5eaeddb445bb5ebcf42877f9bf7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/d47351a8a3754066a21437e32de9dd39, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/220dcd9e927c4a3db24f4e25f1156e4d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e1e25fda5f244f1cbee1a96f2f036307_SeqId_44_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp, totalSize=50.3 K 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 0c4d216b3ccd435c9955ae32438996d4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting e5787ad877734af18ac55e156cc02b3e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 2d2a4bda0f944cfbbd58c68e25ac5745, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting adfbcd8be97341b3b02e5ceb50b87d2e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 8bcdfde36f754c6db1a4f0828726b274, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 91f5df5d6471413fb124677b62029ae7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 0940c5eaeddb445bb5ebcf42877f9bf7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting d47351a8a3754066a21437e32de9dd39, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 220dcd9e927c4a3db24f4e25f1156e4d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 04:55:02,022 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting e1e25fda5f244f1cbee1a96f2f036307_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 04:55:02,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:02,024 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:02,025 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e28e7ede77204528bb5e5b2101f491eb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228e28e7ede77204528bb5e5b2101f491eb 2023-02-13 04:55:02,026 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b2cacf92eb2d4912a2b767ed3023e58c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b2cacf92eb2d4912a2b767ed3023e58c 2023-02-13 04:55:02,028 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101db97bfd0262d4f57be80a7ba08086804 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101db97bfd0262d4f57be80a7ba08086804 2023-02-13 04:55:02,029 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103133b23d11c3240c8bd057cddf57b3ee3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103133b23d11c3240c8bd057cddf57b3ee3 2023-02-13 04:55:02,029 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-13 04:55:02,029 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 04:55:02,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:02,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:02,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:02,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:02,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:02,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:02,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:02,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:02,050 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): df6dd8289209e33a66ab42a45700acff#family1#compaction#72 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:55:02,864 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/0cd330acd8024b0bbd296e06c799cee2 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0cd330acd8024b0bbd296e06c799cee2 2023-02-13 04:55:02,870 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in df6dd8289209e33a66ab42a45700acff/family1 of df6dd8289209e33a66ab42a45700acff into 0cd330acd8024b0bbd296e06c799cee2(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:55:02,870 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:55:02,870 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676264102021; duration=0sec 2023-02-13 04:55:02,870 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:55:02,872 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a2064779b7dc40b28efa0b095eb7b2c6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a2064779b7dc40b28efa0b095eb7b2c6 2023-02-13 04:55:02,873 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:02,897 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/47a213d01dc74511806107eca4a87458 first=Optional[r00] last=Optional[r2] 2023-02-13 04:55:02,898 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/47a213d01dc74511806107eca4a87458}] 2023-02-13 04:55:02,900 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/47a213d01dc74511806107eca4a87458 for inclusion in df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:02,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 04:55:02,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:55:02,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:55:02,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/47a213d01dc74511806107eca4a87458 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3cmcfs8ol9cn0n12r69ebrev5hev9d16pprudv5tr1akssmtfbefloo89i9ssvkd/family1/47a213d01dc74511806107eca4a87458 2023-02-13 04:55:02,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3cmcfs8ol9cn0n12r69ebrev5hev9d16pprudv5tr1akssmtfbefloo89i9ssvkd/family1/47a213d01dc74511806107eca4a87458 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/9601868beff7496abe369545841923a8_SeqId_47_ 2023-02-13 04:55:02,906 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3cmcfs8ol9cn0n12r69ebrev5hev9d16pprudv5tr1akssmtfbefloo89i9ssvkd/family1/47a213d01dc74511806107eca4a87458 into df6dd8289209e33a66ab42a45700acff/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/9601868beff7496abe369545841923a8_SeqId_47_ - updating store file list. 2023-02-13 04:55:02,909 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/9601868beff7496abe369545841923a8_SeqId_47_ into df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:02,910 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3cmcfs8ol9cn0n12r69ebrev5hev9d16pprudv5tr1akssmtfbefloo89i9ssvkd/family1/47a213d01dc74511806107eca4a87458 into df6dd8289209e33a66ab42a45700acff/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/9601868beff7496abe369545841923a8_SeqId_47_) 2023-02-13 04:55:02,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__3cmcfs8ol9cn0n12r69ebrev5hev9d16pprudv5tr1akssmtfbefloo89i9ssvkd/family1/47a213d01dc74511806107eca4a87458 2023-02-13 04:55:02,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 04:55:02,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 04:55:02,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): df6dd8289209e33a66ab42a45700acff/family1 is initiating minor compaction (all files) 2023-02-13 04:55:02,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7163f00b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:55:02,911 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of df6dd8289209e33a66ab42a45700acff/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:02,911 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/4c89b0bdbfad4da898ffe3c9fd7d59ec, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0cd330acd8024b0bbd296e06c799cee2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/9601868beff7496abe369545841923a8_SeqId_47_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp, totalSize=388.1 K 2023-02-13 04:55:02,912 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 4c89b0bdbfad4da898ffe3c9fd7d59ec, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843565 2023-02-13 04:55:02,912 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 0cd330acd8024b0bbd296e06c799cee2, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243565 2023-02-13 04:55:02,913 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 9601868beff7496abe369545841923a8_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878843565 2023-02-13 04:55:02,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:02,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:02,915 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113049421d1f9ab044e68e5c34cc2c2f9d58 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113049421d1f9ab044e68e5c34cc2c2f9d58 2023-02-13 04:55:02,916 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512015000f0e2e0c94fa295812e90319f2b5e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512015000f0e2e0c94fa295812e90319f2b5e 2023-02-13 04:55:02,917 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205737835bf59c0441c9afb1402c1927994 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205737835bf59c0441c9afb1402c1927994 2023-02-13 04:55:02,917 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-13 04:55:02,917 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 04:55:02,918 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:02,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:02,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:55:02,919 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 04:55:02,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.7910 sec 2023-02-13 04:55:02,929 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): df6dd8289209e33a66ab42a45700acff#family1#compaction#73 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:55:02,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0c4d216b3ccd435c9955ae32438996d4, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e5787ad877734af18ac55e156cc02b3e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/2d2a4bda0f944cfbbd58c68e25ac5745, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/adfbcd8be97341b3b02e5ceb50b87d2e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/8bcdfde36f754c6db1a4f0828726b274, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/91f5df5d6471413fb124677b62029ae7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0940c5eaeddb445bb5ebcf42877f9bf7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/d47351a8a3754066a21437e32de9dd39, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/220dcd9e927c4a3db24f4e25f1156e4d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e1e25fda5f244f1cbee1a96f2f036307_SeqId_44_] to archive 2023-02-13 04:55:02,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:02,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0c4d216b3ccd435c9955ae32438996d4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0c4d216b3ccd435c9955ae32438996d4 2023-02-13 04:55:02,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e5787ad877734af18ac55e156cc02b3e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e5787ad877734af18ac55e156cc02b3e 2023-02-13 04:55:02,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/2d2a4bda0f944cfbbd58c68e25ac5745 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/2d2a4bda0f944cfbbd58c68e25ac5745 2023-02-13 04:55:02,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/adfbcd8be97341b3b02e5ceb50b87d2e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/adfbcd8be97341b3b02e5ceb50b87d2e 2023-02-13 04:55:02,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/8bcdfde36f754c6db1a4f0828726b274 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/8bcdfde36f754c6db1a4f0828726b274 2023-02-13 04:55:02,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/91f5df5d6471413fb124677b62029ae7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/91f5df5d6471413fb124677b62029ae7 2023-02-13 04:55:02,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0940c5eaeddb445bb5ebcf42877f9bf7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0940c5eaeddb445bb5ebcf42877f9bf7 2023-02-13 04:55:02,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/d47351a8a3754066a21437e32de9dd39 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/d47351a8a3754066a21437e32de9dd39 2023-02-13 04:55:02,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/220dcd9e927c4a3db24f4e25f1156e4d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/220dcd9e927c4a3db24f4e25f1156e4d 2023-02-13 04:55:02,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e1e25fda5f244f1cbee1a96f2f036307_SeqId_44_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/e1e25fda5f244f1cbee1a96f2f036307_SeqId_44_ 2023-02-13 04:55:03,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 04:55:03,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:03,375 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/.tmp/family1/5a269373613c43708bd0dada73318793 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/5a269373613c43708bd0dada73318793 2023-02-13 04:55:03,380 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in df6dd8289209e33a66ab42a45700acff/family1 of df6dd8289209e33a66ab42a45700acff into 5a269373613c43708bd0dada73318793(size=192.4 K), total size for store is 192.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:55:03,380 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:55:03,380 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1676264102911; duration=0sec 2023-02-13 04:55:03,380 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:55:03,415 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 04:55:03,416 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 04:55:03,416 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 04:55:03,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 04:55:03,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, REOPEN/MOVE}] 2023-02-13 04:55:03,421 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, REOPEN/MOVE 2023-02-13 04:55:03,421 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:03,421 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264103421"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264103421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264103421"}]},"ts":"1676264103421"} 2023-02-13 04:55:03,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:03,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/4c89b0bdbfad4da898ffe3c9fd7d59ec, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0cd330acd8024b0bbd296e06c799cee2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/9601868beff7496abe369545841923a8_SeqId_47_] to archive 2023-02-13 04:55:03,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:03,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/4c89b0bdbfad4da898ffe3c9fd7d59ec to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/4c89b0bdbfad4da898ffe3c9fd7d59ec 2023-02-13 04:55:03,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0cd330acd8024b0bbd296e06c799cee2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/0cd330acd8024b0bbd296e06c799cee2 2023-02-13 04:55:03,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/9601868beff7496abe369545841923a8_SeqId_47_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/9601868beff7496abe369545841923a8_SeqId_47_ 2023-02-13 04:55:03,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing df6dd8289209e33a66ab42a45700acff, disabling compactions & flushes 2023-02-13 04:55:03,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. after waiting 0 ms 2023-02-13 04:55:03,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:03,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 04:55:03,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:03,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for df6dd8289209e33a66ab42a45700acff: Waiting for close lock at 1676264103574Running coprocessor pre-close hooks at 1676264103574Disabling compacts and flushes for region at 1676264103574Disabling writes for close at 1676264103574Writing region close event to WAL at 1676264103576 (+2 ms)Running coprocessor post-close hooks at 1676264103579 (+3 ms)Closed at 1676264103579 2023-02-13 04:55:03,580 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: df6dd8289209e33a66ab42a45700acff to self. 2023-02-13 04:55:03,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:03,581 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=CLOSED 2023-02-13 04:55:03,581 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264103581"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264103581"}]},"ts":"1676264103581"} 2023-02-13 04:55:03,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-13 04:55:03,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660 in 160 msec 2023-02-13 04:55:03,584 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=true 2023-02-13 04:55:03,734 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:03,734 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264103734"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264103734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264103734"}]},"ts":"1676264103734"} 2023-02-13 04:55:03,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:03,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:03,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => df6dd8289209e33a66ab42a45700acff, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:55:03,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:03,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:03,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:03,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:03,892 INFO [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:03,893 DEBUG [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:03,893 DEBUG [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:03,893 INFO [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df6dd8289209e33a66ab42a45700acff columnFamilyName family1 2023-02-13 04:55:03,897 DEBUG [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/5a269373613c43708bd0dada73318793 2023-02-13 04:55:03,897 INFO [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] regionserver.HStore(310): Store=df6dd8289209e33a66ab42a45700acff/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:03,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:03,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:03,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:03,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened df6dd8289209e33a66ab42a45700acff; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71395754, jitterRate=0.06387963891029358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:55:03,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for df6dd8289209e33a66ab42a45700acff: Running coprocessor pre-open hook at 1676264103891Writing region info on filesystem at 1676264103891Initializing all the Stores at 1676264103891Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676264103892 (+1 ms)Cleaning up temporary data from old regions at 1676264103899 (+7 ms)Cleaning up detritus from prior splits at 1676264103900 (+1 ms)Running coprocessor post-open hooks at 1676264103902 (+2 ms)Region opened successfully at 1676264103902 2023-02-13 04:55:03,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff., pid=63, masterSystemTime=1676264103887 2023-02-13 04:55:03,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:03,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:03,904 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:03,904 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264103904"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264103904"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264103904"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264103904"}]},"ts":"1676264103904"} 2023-02-13 04:55:03,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-13 04:55:03,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660 in 169 msec 2023-02-13 04:55:03,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-13 04:55:03,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, REOPEN/MOVE in 486 msec 2023-02-13 04:55:03,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-13 04:55:03,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 490 msec 2023-02-13 04:55:03,910 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 903 msec 2023-02-13 04:55:03,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-13 04:55:03,912 INFO [Listener at localhost/37751] compactions.TestMobCompactor(278): alter status finished 2023-02-13 04:55:03,913 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:03,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 04:55:03,915 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 04:55:03,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:55:03,915 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264703915 2023-02-13 04:55:03,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:55:03,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 04:55:03,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:03,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x395ef604 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:55:03,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fa22cd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:55:03,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:03,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:03,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:03,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:03,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:04,745 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280a8cc6488d804946940f12ca6002d5d4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280a8cc6488d804946940f12ca6002d5d4 2023-02-13 04:55:04,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:04,758 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:55:04,759 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50452, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:55:04,765 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:55:04,766 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57206, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:55:04,773 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/555ff2cd129f4032a88f7c5534ef41f2 first=Optional[r05] last=Optional[r8] 2023-02-13 04:55:04,774 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/555ff2cd129f4032a88f7c5534ef41f2}] 2023-02-13 04:55:04,777 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/555ff2cd129f4032a88f7c5534ef41f2 for inclusion in df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:04,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 04:55:04,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:55:04,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for df6dd8289209e33a66ab42a45700acff: 2023-02-13 04:55:04,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/555ff2cd129f4032a88f7c5534ef41f2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ljshql1fnkci81mk6b6297ckvvoqhrp1fn54a0mnashs9h9uva863qhbklgnruur/family1/555ff2cd129f4032a88f7c5534ef41f2 2023-02-13 04:55:04,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ljshql1fnkci81mk6b6297ckvvoqhrp1fn54a0mnashs9h9uva863qhbklgnruur/family1/555ff2cd129f4032a88f7c5534ef41f2 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/135600008be541f298aaee0b11eacf74_SeqId_53_ 2023-02-13 04:55:04,783 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ljshql1fnkci81mk6b6297ckvvoqhrp1fn54a0mnashs9h9uva863qhbklgnruur/family1/555ff2cd129f4032a88f7c5534ef41f2 into df6dd8289209e33a66ab42a45700acff/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/135600008be541f298aaee0b11eacf74_SeqId_53_ - updating store file list. 2023-02-13 04:55:04,786 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/135600008be541f298aaee0b11eacf74_SeqId_53_ into df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:04,786 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ljshql1fnkci81mk6b6297ckvvoqhrp1fn54a0mnashs9h9uva863qhbklgnruur/family1/555ff2cd129f4032a88f7c5534ef41f2 into df6dd8289209e33a66ab42a45700acff/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/135600008be541f298aaee0b11eacf74_SeqId_53_) 2023-02-13 04:55:04,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ljshql1fnkci81mk6b6297ckvvoqhrp1fn54a0mnashs9h9uva863qhbklgnruur/family1/555ff2cd129f4032a88f7c5534ef41f2 2023-02-13 04:55:04,788 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:04,788 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:04,790 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511209c619a7270c145829ee89c8ab0237197 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511209c619a7270c145829ee89c8ab0237197 2023-02-13 04:55:04,791 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280d8b4583aec340e1ab2a5c7e17fd03f7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280d8b4583aec340e1ab2a5c7e17fd03f7 2023-02-13 04:55:04,791 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-13 04:55:04,791 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 04:55:04,791 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:04,791 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:04,791 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:04,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:04,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:55:04,792 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 04:55:04,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 878 msec 2023-02-13 04:55:04,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-13 04:55:04,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:05,251 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 04:55:05,252 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 04:55:05,252 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 04:55:05,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 04:55:05,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, REOPEN/MOVE}] 2023-02-13 04:55:05,257 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, REOPEN/MOVE 2023-02-13 04:55:05,257 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:05,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264105257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264105257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264105257"}]},"ts":"1676264105257"} 2023-02-13 04:55:05,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:05,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:05,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing df6dd8289209e33a66ab42a45700acff, disabling compactions & flushes 2023-02-13 04:55:05,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:05,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:05,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. after waiting 0 ms 2023-02-13 04:55:05,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:05,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 04:55:05,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:05,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for df6dd8289209e33a66ab42a45700acff: Waiting for close lock at 1676264105411Running coprocessor pre-close hooks at 1676264105411Disabling compacts and flushes for region at 1676264105411Disabling writes for close at 1676264105411Writing region close event to WAL at 1676264105416 (+5 ms)Running coprocessor post-close hooks at 1676264105419 (+3 ms)Closed at 1676264105420 (+1 ms) 2023-02-13 04:55:05,420 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: df6dd8289209e33a66ab42a45700acff to self. 2023-02-13 04:55:05,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:05,421 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=CLOSED 2023-02-13 04:55:05,422 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264105421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264105421"}]},"ts":"1676264105421"} 2023-02-13 04:55:05,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-13 04:55:05,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660 in 164 msec 2023-02-13 04:55:05,424 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=true 2023-02-13 04:55:05,575 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:05,575 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264105575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264105575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264105575"}]},"ts":"1676264105575"} 2023-02-13 04:55:05,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:05,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:05,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => df6dd8289209e33a66ab42a45700acff, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:55:05,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:05,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:05,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:05,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:05,732 INFO [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:05,733 DEBUG [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:05,733 DEBUG [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1 2023-02-13 04:55:05,733 INFO [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df6dd8289209e33a66ab42a45700acff columnFamilyName family1 2023-02-13 04:55:05,738 DEBUG [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/135600008be541f298aaee0b11eacf74_SeqId_53_ 2023-02-13 04:55:05,740 DEBUG [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/family1/5a269373613c43708bd0dada73318793 2023-02-13 04:55:05,741 INFO [StoreOpener-df6dd8289209e33a66ab42a45700acff-1] regionserver.HStore(310): Store=df6dd8289209e33a66ab42a45700acff/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:05,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:05,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:05,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:55:05,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened df6dd8289209e33a66ab42a45700acff; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71837507, jitterRate=0.07046227157115936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:55:05,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for df6dd8289209e33a66ab42a45700acff: Running coprocessor pre-open hook at 1676264105731Writing region info on filesystem at 1676264105731Initializing all the Stores at 1676264105732 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676264105732Cleaning up temporary data from old regions at 1676264105743 (+11 ms)Cleaning up detritus from prior splits at 1676264105743Running coprocessor post-open hooks at 1676264105745 (+2 ms)Region opened successfully at 1676264105745 2023-02-13 04:55:05,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff., pid=69, masterSystemTime=1676264105728 2023-02-13 04:55:05,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:05,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:55:05,747 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=df6dd8289209e33a66ab42a45700acff, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:05,747 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676264105747"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264105747"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264105747"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264105747"}]},"ts":"1676264105747"} 2023-02-13 04:55:05,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-13 04:55:05,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure df6dd8289209e33a66ab42a45700acff, server=jenkins-hbase4.apache.org,37513,1676264019660 in 171 msec 2023-02-13 04:55:05,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-13 04:55:05,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=df6dd8289209e33a66ab42a45700acff, REOPEN/MOVE in 493 msec 2023-02-13 04:55:05,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-13 04:55:05,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 497 msec 2023-02-13 04:55:05,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 911 msec 2023-02-13 04:55:05,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-13 04:55:05,755 INFO [Listener at localhost/37751] compactions.TestMobCompactor(278): alter status finished 2023-02-13 04:55:05,755 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 04:55:05,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 04:55:05,757 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 04:55:05,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:55:05,758 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264705758 2023-02-13 04:55:05,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:55:05,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 04:55:05,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:05,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x770b6402 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:55:05,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f992bf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:55:05,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:05,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:05,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:05,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:05,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:05,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:05,764 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:05,764 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 04:55:05,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 04:55:05,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:55:05,764 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 04:55:05,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 8 msec 2023-02-13 04:55:05,825 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=251 (was 242) - Thread LEAK? -, OpenFileDescriptor=636 (was 616) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 249), ProcessCount=168 (was 168), AvailableMemoryMB=3662 (was 3752) 2023-02-13 04:55:05,835 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=251, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=168, AvailableMemoryMB=3662 2023-02-13 04:55:05,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 04:55:05,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-13 04:55:05,840 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:55:05,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-13 04:55:05,840 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:55:05,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 04:55:05,842 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:05,842 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b empty. 2023-02-13 04:55:05,842 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:05,842 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 04:55:05,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 04:55:06,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 04:55:06,249 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 04:55:06,251 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => cda7127244a7cf1878c6e0c79d95524b, NAME => 'testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:55:06,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 04:55:06,657 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:06,657 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing cda7127244a7cf1878c6e0c79d95524b, disabling compactions & flushes 2023-02-13 04:55:06,657 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:06,657 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:06,657 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. after waiting 0 ms 2023-02-13 04:55:06,657 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:06,657 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:06,657 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for cda7127244a7cf1878c6e0c79d95524b: Waiting for close lock at 1676264106657Disabling compacts and flushes for region at 1676264106657Disabling writes for close at 1676264106657Writing region close event to WAL at 1676264106657Closed at 1676264106657 2023-02-13 04:55:06,659 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:55:06,660 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676264106660"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264106660"}]},"ts":"1676264106660"} 2023-02-13 04:55:06,661 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:55:06,661 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:55:06,662 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264106662"}]},"ts":"1676264106662"} 2023-02-13 04:55:06,662 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-13 04:55:06,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=cda7127244a7cf1878c6e0c79d95524b, ASSIGN}] 2023-02-13 04:55:06,666 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=cda7127244a7cf1878c6e0c79d95524b, ASSIGN 2023-02-13 04:55:06,667 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=cda7127244a7cf1878c6e0c79d95524b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:55:06,818 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=cda7127244a7cf1878c6e0c79d95524b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:06,818 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676264106818"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264106818"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264106818"}]},"ts":"1676264106818"} 2023-02-13 04:55:06,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure cda7127244a7cf1878c6e0c79d95524b, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:06,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 04:55:06,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:06,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cda7127244a7cf1878c6e0c79d95524b, NAME => 'testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:55:06,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-13 04:55:06,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-13 04:55:06,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:06,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:06,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:06,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:06,977 INFO [StoreOpener-cda7127244a7cf1878c6e0c79d95524b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:06,978 DEBUG [StoreOpener-cda7127244a7cf1878c6e0c79d95524b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1 2023-02-13 04:55:06,978 DEBUG [StoreOpener-cda7127244a7cf1878c6e0c79d95524b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1 2023-02-13 04:55:06,979 INFO [StoreOpener-cda7127244a7cf1878c6e0c79d95524b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cda7127244a7cf1878c6e0c79d95524b columnFamilyName f1 2023-02-13 04:55:06,980 INFO [StoreOpener-cda7127244a7cf1878c6e0c79d95524b-1] regionserver.HStore(310): Store=cda7127244a7cf1878c6e0c79d95524b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:06,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:06,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:06,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:06,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:55:06,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cda7127244a7cf1878c6e0c79d95524b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74095813, jitterRate=0.10411365330219269}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:55:06,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cda7127244a7cf1878c6e0c79d95524b: Running coprocessor pre-open hook at 1676264106976Writing region info on filesystem at 1676264106976Initializing all the Stores at 1676264106977 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264106977Cleaning up temporary data from old regions at 1676264106982 (+5 ms)Cleaning up detritus from prior splits at 1676264106982Running coprocessor post-open hooks at 1676264106986 (+4 ms)Region opened successfully at 1676264106986 2023-02-13 04:55:06,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b., pid=73, masterSystemTime=1676264106970 2023-02-13 04:55:06,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:06,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:06,988 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=cda7127244a7cf1878c6e0c79d95524b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:06,988 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676264106988"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264106988"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264106988"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264106988"}]},"ts":"1676264106988"} 2023-02-13 04:55:06,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-13 04:55:06,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure cda7127244a7cf1878c6e0c79d95524b, server=jenkins-hbase4.apache.org,37513,1676264019660 in 170 msec 2023-02-13 04:55:06,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-13 04:55:06,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=cda7127244a7cf1878c6e0c79d95524b, ASSIGN in 326 msec 2023-02-13 04:55:06,992 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:55:06,993 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264106992"}]},"ts":"1676264106992"} 2023-02-13 04:55:06,994 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-13 04:55:06,996 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:55:06,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1580 sec 2023-02-13 04:55:07,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 04:55:07,946 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-13 04:55:07,946 DEBUG [Listener at localhost/37751] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-13 04:55:07,947 INFO [Listener at localhost/37751] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:55:07,950 INFO [Listener at localhost/37751] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-13 04:55:07,951 INFO [Listener at localhost/37751] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:55:07,951 INFO [Listener at localhost/37751] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-13 04:55:07,955 INFO [Listener at localhost/37751] regionserver.HRegion(2744): Flushing cda7127244a7cf1878c6e0c79d95524b 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 04:55:08,366 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302134629745489654f2fa1f44d8d828085c3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302134629745489654f2fa1f44d8d828085c3 2023-02-13 04:55:08,626 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x770b6402 to 127.0.0.1:54862 2023-02-13 04:55:08,626 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:08,626 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:55:08,626 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x395ef604 to 127.0.0.1:54862 2023-02-13 04:55:08,626 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:08,626 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:55:08,626 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f11d8b8 to 127.0.0.1:54862 2023-02-13 04:55:08,626 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:08,627 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a5022b7 to 127.0.0.1:54862 2023-02-13 04:55:08,627 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:08,627 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:55:08,627 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x024dd8de to 127.0.0.1:54862 2023-02-13 04:55:08,627 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:08,627 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:55:08,627 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ecf5e97 to 127.0.0.1:54862 2023-02-13 04:55:08,627 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:08,771 INFO [Listener at localhost/37751] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/.tmp/f1/6f18c9698f784586abe0749f220d4822 2023-02-13 04:55:08,776 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/.tmp/f1/6f18c9698f784586abe0749f220d4822 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822 2023-02-13 04:55:08,780 INFO [Listener at localhost/37751] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 04:55:08,781 INFO [Listener at localhost/37751] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for cda7127244a7cf1878c6e0c79d95524b in 826ms, sequenceid=5, compaction requested=false 2023-02-13 04:55:08,781 DEBUG [Listener at localhost/37751] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-13 04:55:08,781 DEBUG [Listener at localhost/37751] regionserver.HRegion(2445): Flush status journal for cda7127244a7cf1878c6e0c79d95524b: 2023-02-13 04:55:08,783 INFO [Listener at localhost/37751] regionserver.HRegion(2744): Flushing cda7127244a7cf1878c6e0c79d95524b 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 04:55:09,134 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:55:09,171 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-13 04:55:09,171 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-02-13 04:55:09,194 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021386bd3dc980bf4d8fb361764b618f20e9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021386bd3dc980bf4d8fb361764b618f20e9 2023-02-13 04:55:09,599 INFO [Listener at localhost/37751] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/.tmp/f1/b9290ada3d6943ee831ea630d5e389b6 2023-02-13 04:55:09,603 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/.tmp/f1/b9290ada3d6943ee831ea630d5e389b6 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6 2023-02-13 04:55:09,606 INFO [Listener at localhost/37751] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6, entries=1, sequenceid=9, filesize=4.9 K 2023-02-13 04:55:09,607 INFO [Listener at localhost/37751] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for cda7127244a7cf1878c6e0c79d95524b in 824ms, sequenceid=9, compaction requested=false 2023-02-13 04:55:09,607 DEBUG [Listener at localhost/37751] regionserver.HRegion(2445): Flush status journal for cda7127244a7cf1878c6e0c79d95524b: 2023-02-13 04:55:09,609 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-13 04:55:09,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 04:55:09,610 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 04:55:09,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:55:09,611 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264709611 2023-02-13 04:55:09,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 04:55:09,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-13 04:55:09,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-13 04:55:09,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x6e1487dd to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:55:09,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6854d760, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:55:09,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 04:55:09,660 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,660 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,711 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,711 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,762 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,762 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,813 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,813 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,864 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,864 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,915 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,915 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,966 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:09,966 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,017 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,017 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,068 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,068 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,119 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,119 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,169 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,170 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,220 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,220 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,271 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,271 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,322 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,322 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,373 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,373 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,423 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,423 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,444 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213d4cb4328f8a74bf2bc68cabd4177392c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213d4cb4328f8a74bf2bc68cabd4177392c 2023-02-13 04:55:10,444 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 04:55:10,463 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:55:10,464 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50460, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:55:10,470 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:55:10,472 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:55:10,474 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,474 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,481 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/a8f655db35d240aba839362081ac8d40 first=Optional[r1] last=Optional[r2] 2023-02-13 04:55:10,481 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{f1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/a8f655db35d240aba839362081ac8d40}] 2023-02-13 04:55:10,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/a8f655db35d240aba839362081ac8d40 for inclusion in cda7127244a7cf1878c6e0c79d95524b/f1 2023-02-13 04:55:10,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 04:55:10,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:55:10,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for cda7127244a7cf1878c6e0c79d95524b: 2023-02-13 04:55:10,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/a8f655db35d240aba839362081ac8d40 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testGetAfterCompaction__h8imjjsg6p6s199b5ckaincabrfgkq5bknpmte4k76pd8olgf850n6c88677rfe9/f1/a8f655db35d240aba839362081ac8d40 2023-02-13 04:55:10,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testGetAfterCompaction__h8imjjsg6p6s199b5ckaincabrfgkq5bknpmte4k76pd8olgf850n6c88677rfe9/f1/a8f655db35d240aba839362081ac8d40 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_ 2023-02-13 04:55:10,491 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testGetAfterCompaction__h8imjjsg6p6s199b5ckaincabrfgkq5bknpmte4k76pd8olgf850n6c88677rfe9/f1/a8f655db35d240aba839362081ac8d40 into cda7127244a7cf1878c6e0c79d95524b/f1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_ - updating store file list. 2023-02-13 04:55:10,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_ into cda7127244a7cf1878c6e0c79d95524b/f1 2023-02-13 04:55:10,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testGetAfterCompaction__h8imjjsg6p6s199b5ckaincabrfgkq5bknpmte4k76pd8olgf850n6c88677rfe9/f1/a8f655db35d240aba839362081ac8d40 into cda7127244a7cf1878c6e0c79d95524b/f1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_) 2023-02-13 04:55:10,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testGetAfterCompaction__h8imjjsg6p6s199b5ckaincabrfgkq5bknpmte4k76pd8olgf850n6c88677rfe9/f1/a8f655db35d240aba839362081ac8d40 2023-02-13 04:55:10,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): cda7127244a7cf1878c6e0c79d95524b/f1 is initiating minor compaction 2023-02-13 04:55:10,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@29faba47; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:55:10,495 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of cda7127244a7cf1878c6e0c79d95524b/f1 in testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:10,495 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/.tmp, totalSize=10.0 K 2023-02-13 04:55:10,495 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting b9290ada3d6943ee831ea630d5e389b6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 04:55:10,495 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 04:55:10,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 04:55:10,498 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:10,500 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302134629745489654f2fa1f44d8d828085c3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302134629745489654f2fa1f44d8d828085c3 2023-02-13 04:55:10,501 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021386bd3dc980bf4d8fb361764b618f20e9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021386bd3dc980bf4d8fb361764b618f20e9 2023-02-13 04:55:10,501 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-13 04:55:10,501 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 04:55:10,502 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 04:55:10,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-13 04:55:10,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:55:10,503 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 04:55:10,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 894 msec 2023-02-13 04:55:10,508 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): cda7127244a7cf1878c6e0c79d95524b#f1#compaction#76 average throughput is 0.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:55:10,525 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,525 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,525 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,528 DEBUG [Listener at localhost/37751] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:55:10,532 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50476, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:55:10,532 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37513] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:10,533 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-13 04:55:10,533 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 04:55:10,533 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37513] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 04:55:10,533 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37513] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. because compaction request was cancelled 2023-02-13 04:55:10,584 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,584 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,585 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,635 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,635 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,635 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,686 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,686 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,686 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,737 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,737 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,737 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,788 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,788 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,788 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,838 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,839 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,839 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,889 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,889 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,889 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,940 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,940 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,940 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,991 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:10,991 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:10,991 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,042 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:11,042 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,042 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,092 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:11,093 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,093 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,143 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:11,143 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,143 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,194 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:11,194 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,194 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,245 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:11,245 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,245 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,296 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:11,296 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,296 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,323 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/.tmp/f1/9ab5503c53e64db287c3ee2a10c7eec8 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/9ab5503c53e64db287c3ee2a10c7eec8 2023-02-13 04:55:11,327 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in cda7127244a7cf1878c6e0c79d95524b/f1 of cda7127244a7cf1878c6e0c79d95524b into 9ab5503c53e64db287c3ee2a10c7eec8(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:55:11,327 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for cda7127244a7cf1878c6e0c79d95524b: 2023-02-13 04:55:11,327 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676264110495; duration=0sec 2023-02-13 04:55:11,327 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:55:11,346 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:11,346 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,346 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/9ab5503c53e64db287c3ee2a10c7eec8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676264111319; access_time=1676264110500; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,347 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,397 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676264110440; access_time=1676264109628; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 04:55:11,397 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,397 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/9ab5503c53e64db287c3ee2a10c7eec8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676264111319; access_time=1676264110500; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,397 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264109599; access_time=1676264108785; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_] to archive 2023-02-13 04:55:11,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:11,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/b9290ada3d6943ee831ea630d5e389b6 2023-02-13 04:55:11,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/3c141174c79f48a1aa3b5d3c22325c67_SeqId_12_ 2023-02-13 04:55:11,448 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676264108771; access_time=1676264107957; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,448 INFO [Listener at localhost/37751] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/9ab5503c53e64db287c3ee2a10c7eec8; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676264111319; access_time=1676264110500; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 04:55:11,566 INFO [Listener at localhost/37751] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-13 04:55:11,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-02-13 04:55:11,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-13 04:55:11,578 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264111578"}]},"ts":"1676264111578"} 2023-02-13 04:55:11,579 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-13 04:55:11,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 04:55:11,584 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-13 04:55:11,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=cda7127244a7cf1878c6e0c79d95524b, UNASSIGN}] 2023-02-13 04:55:11,587 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=cda7127244a7cf1878c6e0c79d95524b, UNASSIGN 2023-02-13 04:55:11,587 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=cda7127244a7cf1878c6e0c79d95524b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:11,588 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676264111587"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264111587"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264111587"}]},"ts":"1676264111587"} 2023-02-13 04:55:11,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure cda7127244a7cf1878c6e0c79d95524b, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:11,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 04:55:11,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:11,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cda7127244a7cf1878c6e0c79d95524b, disabling compactions & flushes 2023-02-13 04:55:11,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:11,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:11,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. after waiting 0 ms 2023-02-13 04:55:11,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:11,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 04:55:11,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-13 04:55:11,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b. 2023-02-13 04:55:11,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cda7127244a7cf1878c6e0c79d95524b: Waiting for close lock at 1676264111741Running coprocessor pre-close hooks at 1676264111741Disabling compacts and flushes for region at 1676264111741Disabling writes for close at 1676264111741Writing region close event to WAL at 1676264111741Running coprocessor post-close hooks at 1676264111745 (+4 ms)Closed at 1676264111746 (+1 ms) 2023-02-13 04:55:11,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:11,747 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=cda7127244a7cf1878c6e0c79d95524b, regionState=CLOSED 2023-02-13 04:55:11,748 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676264111747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264111747"}]},"ts":"1676264111747"} 2023-02-13 04:55:11,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-13 04:55:11,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure cda7127244a7cf1878c6e0c79d95524b, server=jenkins-hbase4.apache.org,37513,1676264019660 in 160 msec 2023-02-13 04:55:11,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-13 04:55:11,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=cda7127244a7cf1878c6e0c79d95524b, UNASSIGN in 164 msec 2023-02-13 04:55:11,752 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264111752"}]},"ts":"1676264111752"} 2023-02-13 04:55:11,753 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-13 04:55:11,754 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-13 04:55:11,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-02-13 04:55:11,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 04:55:11,881 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-13 04:55:11,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-02-13 04:55:11,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 04:55:11,893 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 04:55:11,894 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 04:55:11,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 04:55:11,897 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:11,899 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1, FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/recovered.edits] 2023-02-13 04:55:11,903 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/6f18c9698f784586abe0749f220d4822 2023-02-13 04:55:11,904 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/9ab5503c53e64db287c3ee2a10c7eec8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/f1/9ab5503c53e64db287c3ee2a10c7eec8 2023-02-13 04:55:11,907 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/recovered.edits/15.seqid to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b/recovered.edits/15.seqid 2023-02-13 04:55:11,908 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testGetAfterCompaction/cda7127244a7cf1878c6e0c79d95524b 2023-02-13 04:55:11,908 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 04:55:11,908 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 04:55:11,909 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-13 04:55:11,911 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213d4cb4328f8a74bf2bc68cabd4177392c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230213d4cb4328f8a74bf2bc68cabd4177392c 2023-02-13 04:55:11,912 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 04:55:11,914 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 04:55:11,934 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-13 04:55:11,937 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-13 04:55:11,938 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 04:55:11,938 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-13 04:55:11,938 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676264111938"}]},"ts":"9223372036854775807"} 2023-02-13 04:55:11,939 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 04:55:11,939 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cda7127244a7cf1878c6e0c79d95524b, NAME => 'testGetAfterCompaction,,1676264105838.cda7127244a7cf1878c6e0c79d95524b.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 04:55:11,939 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-13 04:55:11,939 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676264111939"}]},"ts":"9223372036854775807"} 2023-02-13 04:55:11,940 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-13 04:55:11,943 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 04:55:11,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 57 msec 2023-02-13 04:55:11,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 04:55:11,996 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-13 04:55:12,009 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=236 (was 251), OpenFileDescriptor=597 (was 636), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 200), ProcessCount=168 (was 168), AvailableMemoryMB=3637 (was 3662) 2023-02-13 04:55:12,019 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=236, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=193, ProcessCount=168, AvailableMemoryMB=3637 2023-02-13 04:55:12,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 04:55:12,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-13 04:55:12,023 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:55:12,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-13 04:55:12,023 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:55:12,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 04:55:12,025 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:12,025 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:12,026 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:12,026 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c empty. 2023-02-13 04:55:12,026 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7 empty. 2023-02-13 04:55:12,026 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001 empty. 2023-02-13 04:55:12,026 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:12,026 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:12,026 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:12,026 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-13 04:55:12,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 04:55:12,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 04:55:12,434 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 04:55:12,435 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8cb2fc4355445fe1dc5705702cd065d7, NAME => 'testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:55:12,435 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8937f228f64ed9a20627ea05b6572001, NAME => 'testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:55:12,435 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => f959d9fe54998a7bac6e6957f0f0316c, NAME => 'testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:55:12,444 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:12,444 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 8937f228f64ed9a20627ea05b6572001, disabling compactions & flushes 2023-02-13 04:55:12,444 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:12,444 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:12,444 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. after waiting 0 ms 2023-02-13 04:55:12,444 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:12,444 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:12,444 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 8937f228f64ed9a20627ea05b6572001: Waiting for close lock at 1676264112444Disabling compacts and flushes for region at 1676264112444Disabling writes for close at 1676264112444Writing region close event to WAL at 1676264112444Closed at 1676264112444 2023-02-13 04:55:12,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 04:55:12,843 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:12,843 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 8cb2fc4355445fe1dc5705702cd065d7, disabling compactions & flushes 2023-02-13 04:55:12,843 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:12,843 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:12,843 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. after waiting 0 ms 2023-02-13 04:55:12,843 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:12,843 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:12,843 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 8cb2fc4355445fe1dc5705702cd065d7: Waiting for close lock at 1676264112843Disabling compacts and flushes for region at 1676264112843Disabling writes for close at 1676264112843Writing region close event to WAL at 1676264112843Closed at 1676264112843 2023-02-13 04:55:12,844 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:12,844 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing f959d9fe54998a7bac6e6957f0f0316c, disabling compactions & flushes 2023-02-13 04:55:12,845 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:12,845 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:12,845 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. after waiting 0 ms 2023-02-13 04:55:12,845 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:12,845 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:12,845 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for f959d9fe54998a7bac6e6957f0f0316c: Waiting for close lock at 1676264112844Disabling compacts and flushes for region at 1676264112844Disabling writes for close at 1676264112845 (+1 ms)Writing region close event to WAL at 1676264112845Closed at 1676264112845 2023-02-13 04:55:12,847 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:55:12,847 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264112847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264112847"}]},"ts":"1676264112847"} 2023-02-13 04:55:12,847 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264112847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264112847"}]},"ts":"1676264112847"} 2023-02-13 04:55:12,848 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264112847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264112847"}]},"ts":"1676264112847"} 2023-02-13 04:55:12,849 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 04:55:12,850 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:55:12,850 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264112850"}]},"ts":"1676264112850"} 2023-02-13 04:55:12,851 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 04:55:12,855 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, ASSIGN}] 2023-02-13 04:55:12,856 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, ASSIGN 2023-02-13 04:55:12,856 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, ASSIGN 2023-02-13 04:55:12,856 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, ASSIGN 2023-02-13 04:55:12,857 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:55:12,857 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:55:12,857 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:55:13,008 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f959d9fe54998a7bac6e6957f0f0316c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:13,008 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=8cb2fc4355445fe1dc5705702cd065d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:13,008 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8937f228f64ed9a20627ea05b6572001, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:13,009 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264113008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264113008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264113008"}]},"ts":"1676264113008"} 2023-02-13 04:55:13,009 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264113008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264113008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264113008"}]},"ts":"1676264113008"} 2023-02-13 04:55:13,009 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264113008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264113008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264113008"}]},"ts":"1676264113008"} 2023-02-13 04:55:13,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure f959d9fe54998a7bac6e6957f0f0316c, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:13,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure 8cb2fc4355445fe1dc5705702cd065d7, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:13,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 8937f228f64ed9a20627ea05b6572001, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:13,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 04:55:13,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:13,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f959d9fe54998a7bac6e6957f0f0316c, NAME => 'testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 04:55:13,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:13,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:13,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:13,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:13,167 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:13,168 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1 2023-02-13 04:55:13,168 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1 2023-02-13 04:55:13,169 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f959d9fe54998a7bac6e6957f0f0316c columnFamilyName family1 2023-02-13 04:55:13,170 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(310): Store=f959d9fe54998a7bac6e6957f0f0316c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:13,170 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:13,171 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2 2023-02-13 04:55:13,171 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2 2023-02-13 04:55:13,171 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f959d9fe54998a7bac6e6957f0f0316c columnFamilyName family2 2023-02-13 04:55:13,172 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(310): Store=f959d9fe54998a7bac6e6957f0f0316c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:13,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:13,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:13,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:55:13,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:13,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:55:13,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f959d9fe54998a7bac6e6957f0f0316c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74348379, jitterRate=0.10787717998027802}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:55:13,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f959d9fe54998a7bac6e6957f0f0316c: Running coprocessor pre-open hook at 1676264113166Writing region info on filesystem at 1676264113166Initializing all the Stores at 1676264113167 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264113167Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264113167Cleaning up temporary data from old regions at 1676264113174 (+7 ms)Cleaning up detritus from prior splits at 1676264113174Running coprocessor post-open hooks at 1676264113177 (+3 ms)Region opened successfully at 1676264113177 2023-02-13 04:55:13,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c., pid=83, masterSystemTime=1676264113163 2023-02-13 04:55:13,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:13,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:13,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:13,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8cb2fc4355445fe1dc5705702cd065d7, NAME => 'testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 04:55:13,180 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f959d9fe54998a7bac6e6957f0f0316c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:13,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:13,180 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264113180"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264113180"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264113180"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264113180"}]},"ts":"1676264113180"} 2023-02-13 04:55:13,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:13,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:13,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:13,181 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:13,182 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1 2023-02-13 04:55:13,182 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1 2023-02-13 04:55:13,183 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb2fc4355445fe1dc5705702cd065d7 columnFamilyName family1 2023-02-13 04:55:13,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-02-13 04:55:13,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure f959d9fe54998a7bac6e6957f0f0316c, server=jenkins-hbase4.apache.org,37513,1676264019660 in 171 msec 2023-02-13 04:55:13,184 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(310): Store=8cb2fc4355445fe1dc5705702cd065d7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:13,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, ASSIGN in 329 msec 2023-02-13 04:55:13,184 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:13,185 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2 2023-02-13 04:55:13,185 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2 2023-02-13 04:55:13,185 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb2fc4355445fe1dc5705702cd065d7 columnFamilyName family2 2023-02-13 04:55:13,186 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(310): Store=8cb2fc4355445fe1dc5705702cd065d7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:13,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:13,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:13,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:55:13,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:13,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:55:13,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8cb2fc4355445fe1dc5705702cd065d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68440643, jitterRate=0.019845053553581238}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:55:13,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8cb2fc4355445fe1dc5705702cd065d7: Running coprocessor pre-open hook at 1676264113180Writing region info on filesystem at 1676264113180Initializing all the Stores at 1676264113181 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264113181Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264113181Cleaning up temporary data from old regions at 1676264113187 (+6 ms)Cleaning up detritus from prior splits at 1676264113187Running coprocessor post-open hooks at 1676264113191 (+4 ms)Region opened successfully at 1676264113191 2023-02-13 04:55:13,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7., pid=84, masterSystemTime=1676264113163 2023-02-13 04:55:13,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:13,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:13,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:13,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8937f228f64ed9a20627ea05b6572001, NAME => 'testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 04:55:13,193 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=8cb2fc4355445fe1dc5705702cd065d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:13,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:13,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:13,193 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264113193"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264113193"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264113193"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264113193"}]},"ts":"1676264113193"} 2023-02-13 04:55:13,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:13,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:13,194 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:13,195 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1 2023-02-13 04:55:13,195 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1 2023-02-13 04:55:13,196 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8937f228f64ed9a20627ea05b6572001 columnFamilyName family1 2023-02-13 04:55:13,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-02-13 04:55:13,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure 8cb2fc4355445fe1dc5705702cd065d7, server=jenkins-hbase4.apache.org,37513,1676264019660 in 183 msec 2023-02-13 04:55:13,196 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(310): Store=8937f228f64ed9a20627ea05b6572001/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:13,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, ASSIGN in 341 msec 2023-02-13 04:55:13,197 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:13,198 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2 2023-02-13 04:55:13,198 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2 2023-02-13 04:55:13,198 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8937f228f64ed9a20627ea05b6572001 columnFamilyName family2 2023-02-13 04:55:13,199 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(310): Store=8937f228f64ed9a20627ea05b6572001/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:13,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:13,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:13,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:55:13,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:13,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:55:13,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8937f228f64ed9a20627ea05b6572001; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72842954, jitterRate=0.08544459939002991}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:55:13,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8937f228f64ed9a20627ea05b6572001: Running coprocessor pre-open hook at 1676264113193Writing region info on filesystem at 1676264113193Initializing all the Stores at 1676264113194 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264113194Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264113194Cleaning up temporary data from old regions at 1676264113201 (+7 ms)Cleaning up detritus from prior splits at 1676264113201Running coprocessor post-open hooks at 1676264113205 (+4 ms)Region opened successfully at 1676264113205 2023-02-13 04:55:13,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001., pid=85, masterSystemTime=1676264113163 2023-02-13 04:55:13,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:13,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:13,207 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8937f228f64ed9a20627ea05b6572001, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:13,207 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264113207"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264113207"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264113207"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264113207"}]},"ts":"1676264113207"} 2023-02-13 04:55:13,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=81 2023-02-13 04:55:13,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 8937f228f64ed9a20627ea05b6572001, server=jenkins-hbase4.apache.org,37513,1676264019660 in 197 msec 2023-02-13 04:55:13,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-02-13 04:55:13,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, ASSIGN in 355 msec 2023-02-13 04:55:13,211 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:55:13,211 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264113211"}]},"ts":"1676264113211"} 2023-02-13 04:55:13,212 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 04:55:13,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:55:13,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.1930 sec 2023-02-13 04:55:14,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 04:55:14,128 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-13 04:55:14,135 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:14,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:14,137 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:14,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:14,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 04:55:14,141 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 04:55:14,141 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:14,141 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 04:55:14,141 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 04:55:14,141 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:14,142 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:14,144 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:14,144 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:14,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:14,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:14,144 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:14,144 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:14,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:14,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:14,145 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 04:55:14,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 04:55:14,145 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 04:55:14,145 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:14,145 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 04:55:14,145 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:14,145 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. started... 2023-02-13 04:55:14,145 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:14,145 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:14,146 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:14,146 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f959d9fe54998a7bac6e6957f0f0316c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 04:55:14,146 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. started... 2023-02-13 04:55:14,146 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:14,145 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. started... 2023-02-13 04:55:14,147 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8937f228f64ed9a20627ea05b6572001 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 04:55:14,147 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8cb2fc4355445fe1dc5705702cd065d7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 04:55:14,162 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302133772d2d49d094ab5859cff891286e3bd to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302133772d2d49d094ab5859cff891286e3bd 2023-02-13 04:55:14,173 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/f2763d4a860a422fbae6bddcda8ed99e 2023-02-13 04:55:14,560 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213319c7c45e3944d1f995e98ce5d1400b4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213319c7c45e3944d1f995e98ce5d1400b4 2023-02-13 04:55:14,568 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021379254681002e48f0be3ca5638e7b32fb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021379254681002e48f0be3ca5638e7b32fb 2023-02-13 04:55:14,586 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213d1bc381dc2e1499199858718360e4a40 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213d1bc381dc2e1499199858718360e4a40 2023-02-13 04:55:14,965 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/6bd7e96b2ec742048a2b78a87c1471ad 2023-02-13 04:55:14,973 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/60547bad0bab4d8c862c6549201f3182 2023-02-13 04:55:14,991 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/bede7df0eb7a4fb19a6a3a86e279b7f8 2023-02-13 04:55:14,994 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/f2763d4a860a422fbae6bddcda8ed99e as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/f2763d4a860a422fbae6bddcda8ed99e 2023-02-13 04:55:14,998 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/f2763d4a860a422fbae6bddcda8ed99e, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 04:55:14,998 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/bede7df0eb7a4fb19a6a3a86e279b7f8 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/bede7df0eb7a4fb19a6a3a86e279b7f8 2023-02-13 04:55:15,001 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/bede7df0eb7a4fb19a6a3a86e279b7f8, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 04:55:15,002 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8cb2fc4355445fe1dc5705702cd065d7 in 855ms, sequenceid=5, compaction requested=false 2023-02-13 04:55:15,002 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-13 04:55:15,002 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:15,002 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:15,003 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:15,380 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021379a6fd4262434995969d00028b3dbc58 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379a6fd4262434995969d00028b3dbc58 2023-02-13 04:55:15,386 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021333a3961b7d8e4b22b785ad398eedc1e8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021333a3961b7d8e4b22b785ad398eedc1e8 2023-02-13 04:55:15,785 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/c272a749b9b84b57af4555f49c0a879c 2023-02-13 04:55:15,789 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/6bd7e96b2ec742048a2b78a87c1471ad as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/6bd7e96b2ec742048a2b78a87c1471ad 2023-02-13 04:55:15,790 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/92bca81010524d70a4db84733e0dac74 2023-02-13 04:55:15,793 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/6bd7e96b2ec742048a2b78a87c1471ad, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 04:55:15,794 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/c272a749b9b84b57af4555f49c0a879c as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/c272a749b9b84b57af4555f49c0a879c 2023-02-13 04:55:15,794 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/60547bad0bab4d8c862c6549201f3182 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/60547bad0bab4d8c862c6549201f3182 2023-02-13 04:55:15,798 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/c272a749b9b84b57af4555f49c0a879c, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 04:55:15,798 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/60547bad0bab4d8c862c6549201f3182, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 04:55:15,798 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8937f228f64ed9a20627ea05b6572001 in 1651ms, sequenceid=5, compaction requested=false 2023-02-13 04:55:15,799 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:15,799 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:15,799 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/92bca81010524d70a4db84733e0dac74 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/92bca81010524d70a4db84733e0dac74 2023-02-13 04:55:15,799 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:15,803 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/92bca81010524d70a4db84733e0dac74, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 04:55:15,804 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f959d9fe54998a7bac6e6957f0f0316c in 1658ms, sequenceid=5, compaction requested=false 2023-02-13 04:55:15,804 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:15,804 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:15,804 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:15,804 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:15,804 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,804 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 04:55:15,804 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 04:55:15,805 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:15,805 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:15,806 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:15,806 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:15,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:15,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 04:55:15,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40213c29[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:15,807 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 04:55:15,807 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:15,808 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:15,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:15,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:15,808 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 04:55:15,808 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 04:55:15,808 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:15,808 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,808 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:15,809 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 04:55:15,809 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,809 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:15,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:15,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:15,809 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 04:55:15,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:15,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:15,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:15,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:15,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:15,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:15,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 04:55:15,811 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 04:55:15,811 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:15,811 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:15,811 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 04:55:15,811 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:15,813 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:15,813 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:15,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:15,813 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:15,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:15,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:15,814 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:15,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:15,815 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:15,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:15,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:15,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:15,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 04:55:15,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:15,817 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:15,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:15,817 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:15,917 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:15,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:15,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:15,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:15,919 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:15,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:15,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 04:55:15,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 04:55:15,923 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 04:55:15,923 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:15,923 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 04:55:15,923 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 04:55:15,924 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:15,924 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:15,925 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,925 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:15,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:15,925 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:15,925 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:15,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:15,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:15,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 04:55:15,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 04:55:15,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 04:55:15,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 04:55:15,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:15,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 04:55:15,926 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:15,926 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. started... 2023-02-13 04:55:15,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:15,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:15,926 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:15,927 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f959d9fe54998a7bac6e6957f0f0316c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 04:55:15,926 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:15,927 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. started... 2023-02-13 04:55:15,927 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. started... 2023-02-13 04:55:15,927 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8937f228f64ed9a20627ea05b6572001 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 04:55:15,927 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8cb2fc4355445fe1dc5705702cd065d7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 04:55:16,340 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a34d1e9cd76e46d88927a1609345925c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a34d1e9cd76e46d88927a1609345925c 2023-02-13 04:55:16,340 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021347f6ad364105437790da65f217f632a8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021347f6ad364105437790da65f217f632a8 2023-02-13 04:55:16,340 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302138aa17bb4423d499c89e7f8a557cfd9c9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138aa17bb4423d499c89e7f8a557cfd9c9 2023-02-13 04:55:16,347 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/d372afe1de784aec8b39d308768b70aa 2023-02-13 04:55:16,746 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/8e96a6378c1b444e90d537320ed1a301 2023-02-13 04:55:16,747 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/0417ff3fc0214f6c8d3f415d27e82bc8 2023-02-13 04:55:16,760 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302138abc9e3c4d264a42a25b10d86dd9e0af to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302138abc9e3c4d264a42a25b10d86dd9e0af 2023-02-13 04:55:16,764 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/59b8e3a0514c42b4b36e2eb77f1f730d 2023-02-13 04:55:16,767 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/d372afe1de784aec8b39d308768b70aa as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/d372afe1de784aec8b39d308768b70aa 2023-02-13 04:55:16,770 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/d372afe1de784aec8b39d308768b70aa, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 04:55:16,771 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/59b8e3a0514c42b4b36e2eb77f1f730d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/59b8e3a0514c42b4b36e2eb77f1f730d 2023-02-13 04:55:16,774 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/59b8e3a0514c42b4b36e2eb77f1f730d, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 04:55:16,775 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8cb2fc4355445fe1dc5705702cd065d7 in 848ms, sequenceid=9, compaction requested=false 2023-02-13 04:55:16,775 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:16,775 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:16,775 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:17,160 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302138472c735c53845df86d0445ec6e6aba4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138472c735c53845df86d0445ec6e6aba4 2023-02-13 04:55:17,162 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213f0bf6eb2efdd455bbab991a87a25663c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213f0bf6eb2efdd455bbab991a87a25663c 2023-02-13 04:55:17,247 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:55:17,566 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/35be733fbe06433690e053a6be9048a0 2023-02-13 04:55:17,567 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/947e710f0b6a4d8d8fee8c2a4464cd91 2023-02-13 04:55:17,570 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/8e96a6378c1b444e90d537320ed1a301 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8e96a6378c1b444e90d537320ed1a301 2023-02-13 04:55:17,570 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/0417ff3fc0214f6c8d3f415d27e82bc8 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/0417ff3fc0214f6c8d3f415d27e82bc8 2023-02-13 04:55:17,573 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8e96a6378c1b444e90d537320ed1a301, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 04:55:17,574 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/0417ff3fc0214f6c8d3f415d27e82bc8, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 04:55:17,574 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/35be733fbe06433690e053a6be9048a0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/35be733fbe06433690e053a6be9048a0 2023-02-13 04:55:17,574 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/947e710f0b6a4d8d8fee8c2a4464cd91 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/947e710f0b6a4d8d8fee8c2a4464cd91 2023-02-13 04:55:17,579 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/35be733fbe06433690e053a6be9048a0, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 04:55:17,579 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/947e710f0b6a4d8d8fee8c2a4464cd91, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 04:55:17,580 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f959d9fe54998a7bac6e6957f0f0316c in 1653ms, sequenceid=9, compaction requested=false 2023-02-13 04:55:17,580 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:17,580 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:17,580 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8937f228f64ed9a20627ea05b6572001 in 1653ms, sequenceid=9, compaction requested=false 2023-02-13 04:55:17,580 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:17,580 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 04:55:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 04:55:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:17,582 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:17,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:17,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 04:55:17,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@673e77c5[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:17,583 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 04:55:17,583 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:17,584 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:17,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 04:55:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 04:55:17,584 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,584 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:17,586 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 04:55:17,586 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,586 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:17,586 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 04:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:17,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 04:55:17,588 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 04:55:17,588 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:17,588 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:17,588 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 04:55:17,588 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:17,590 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:17,590 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:17,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:17,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:17,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:17,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:17,590 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:17,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:17,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:17,591 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:17,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,592 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,594 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,594 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:17,594 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:17,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:17,594 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:17,594 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:17,594 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 04:55:17,594 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:17,594 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:17,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:17,594 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:17,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:17,594 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:17,595 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:17,595 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:17,695 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:17,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:17,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:17,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:17,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:17,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:17,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 04:55:17,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 04:55:17,702 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 04:55:17,702 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:17,702 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 04:55:17,702 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 04:55:17,702 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:17,702 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:17,703 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,703 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:17,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:17,704 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:17,704 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:17,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:17,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:17,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:17,705 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 04:55:17,705 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 04:55:17,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 04:55:17,705 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 04:55:17,705 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:17,705 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 04:55:17,705 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:17,705 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. started... 2023-02-13 04:55:17,705 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:17,705 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:17,705 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f959d9fe54998a7bac6e6957f0f0316c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 04:55:17,705 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:17,705 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. started... 2023-02-13 04:55:17,705 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:17,705 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. started... 2023-02-13 04:55:17,706 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8937f228f64ed9a20627ea05b6572001 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 04:55:17,706 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8cb2fc4355445fe1dc5705702cd065d7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 04:55:18,130 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213fa2e16b102c04c29ab5b264265228241 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fa2e16b102c04c29ab5b264265228241 2023-02-13 04:55:18,130 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213740cc6c27d6442e7af12f70600684ebe to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213740cc6c27d6442e7af12f70600684ebe 2023-02-13 04:55:18,133 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302130f9b57e163594b44a699ebe9a13a66e4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130f9b57e163594b44a699ebe9a13a66e4 2023-02-13 04:55:18,538 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/9bf697f7cee647f297ab393619709ad9 2023-02-13 04:55:18,539 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/a315feb18b2849578e7ffdc931ed46be 2023-02-13 04:55:18,539 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/c98de4962b724fa6b1c5fe534e8d74b9 2023-02-13 04:55:18,647 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-13 04:55:18,958 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213eb2f8c20fc6f4dc098fc845f87a50bbe to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eb2f8c20fc6f4dc098fc845f87a50bbe 2023-02-13 04:55:18,958 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021359771b87577a44688abb450c6d04d082 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021359771b87577a44688abb450c6d04d082 2023-02-13 04:55:18,958 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302133b96764a6fad4e5882cd2dc0f1ef583b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302133b96764a6fad4e5882cd2dc0f1ef583b 2023-02-13 04:55:19,365 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/d827348a583044009ebfadcec6ea38b9 2023-02-13 04:55:19,365 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/bb73c7733dcc46b0887a90cadfde5987 2023-02-13 04:55:19,365 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/1340fb92dd5a45de80302444387bc5d2 2023-02-13 04:55:19,369 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/a315feb18b2849578e7ffdc931ed46be as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a315feb18b2849578e7ffdc931ed46be 2023-02-13 04:55:19,369 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/c98de4962b724fa6b1c5fe534e8d74b9 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/c98de4962b724fa6b1c5fe534e8d74b9 2023-02-13 04:55:19,369 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/9bf697f7cee647f297ab393619709ad9 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/9bf697f7cee647f297ab393619709ad9 2023-02-13 04:55:19,373 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a315feb18b2849578e7ffdc931ed46be, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 04:55:19,373 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/c98de4962b724fa6b1c5fe534e8d74b9, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 04:55:19,373 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/9bf697f7cee647f297ab393619709ad9, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 04:55:19,374 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/d827348a583044009ebfadcec6ea38b9 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/d827348a583044009ebfadcec6ea38b9 2023-02-13 04:55:19,374 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/1340fb92dd5a45de80302444387bc5d2 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/1340fb92dd5a45de80302444387bc5d2 2023-02-13 04:55:19,374 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/bb73c7733dcc46b0887a90cadfde5987 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/bb73c7733dcc46b0887a90cadfde5987 2023-02-13 04:55:19,378 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/d827348a583044009ebfadcec6ea38b9, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 04:55:19,378 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/bb73c7733dcc46b0887a90cadfde5987, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 04:55:19,378 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/1340fb92dd5a45de80302444387bc5d2, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 04:55:19,379 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f959d9fe54998a7bac6e6957f0f0316c in 1673ms, sequenceid=13, compaction requested=true 2023-02-13 04:55:19,379 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8937f228f64ed9a20627ea05b6572001 in 1673ms, sequenceid=13, compaction requested=true 2023-02-13 04:55:19,379 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:19,379 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:19,379 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:19,379 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8cb2fc4355445fe1dc5705702cd065d7 in 1672ms, sequenceid=13, compaction requested=true 2023-02-13 04:55:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:19,379 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:19,379 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:19,379 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 04:55:19,379 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 04:55:19,381 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:19,381 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:19,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:19,381 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:19,381 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:19,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:19,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:19,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:19,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:19,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 04:55:19,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fdb0025[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:19,382 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 04:55:19,382 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:19,384 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:19,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:19,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:19,384 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 04:55:19,384 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,384 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:19,384 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 04:55:19,384 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:19,393 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 04:55:19,393 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,393 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:19,393 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 04:55:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:19,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:19,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 04:55:19,395 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 04:55:19,395 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:19,395 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:19,395 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 04:55:19,395 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:19,396 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:19,397 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:19,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:19,397 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:19,397 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:19,398 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:19,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:19,400 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:19,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:19,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:19,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:19,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:19,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 04:55:19,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:19,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:19,400 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:19,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:19,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:19,401 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:19,401 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:19,401 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:19,501 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:19,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:19,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:19,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:19,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:19,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:19,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 04:55:19,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 04:55:19,507 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 04:55:19,507 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:19,507 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 04:55:19,507 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 04:55:19,508 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:19,508 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:19,509 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:19,509 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:19,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:19,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:19,510 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:19,510 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:19,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:19,511 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 04:55:19,511 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 04:55:19,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 04:55:19,511 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 04:55:19,511 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:19,511 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 04:55:19,511 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:19,511 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:19,511 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. started... 2023-02-13 04:55:19,511 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:19,511 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. started... 2023-02-13 04:55:19,511 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:19,512 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f959d9fe54998a7bac6e6957f0f0316c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 04:55:19,512 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8cb2fc4355445fe1dc5705702cd065d7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 04:55:19,512 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:19,512 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. started... 2023-02-13 04:55:19,512 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8937f228f64ed9a20627ea05b6572001 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 04:55:19,925 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302134cc030cdad9e4d628dc5f287960172bc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134cc030cdad9e4d628dc5f287960172bc 2023-02-13 04:55:19,925 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021348b3c1f2652541588c20bea476922c01 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021348b3c1f2652541588c20bea476922c01 2023-02-13 04:55:19,925 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213fb132639c629466691e84d7d939abd88 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fb132639c629466691e84d7d939abd88 2023-02-13 04:55:19,931 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/a62f3d4ab4f144ea90789a677febfe0d 2023-02-13 04:55:19,937 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/d05b8ad3e91b4da38d02507094745b02 2023-02-13 04:55:20,332 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/2b16bdf31e8c47d39baa16db6747d6bf 2023-02-13 04:55:20,344 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021384526cf51294437ab50537734234504e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021384526cf51294437ab50537734234504e 2023-02-13 04:55:20,351 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021328f2d0dcb6a048309c40b9c3e44ec9b9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021328f2d0dcb6a048309c40b9c3e44ec9b9 2023-02-13 04:55:20,745 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213c3ce0918c526415e8d0b4b4ac90c4fd0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c3ce0918c526415e8d0b4b4ac90c4fd0 2023-02-13 04:55:20,748 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/e098b7eafd174a76a920cabd74b1518c 2023-02-13 04:55:20,752 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/a62f3d4ab4f144ea90789a677febfe0d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a62f3d4ab4f144ea90789a677febfe0d 2023-02-13 04:55:20,755 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/2a44435d64fd4dd6a9a9c40202150f38 2023-02-13 04:55:20,755 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a62f3d4ab4f144ea90789a677febfe0d, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 04:55:20,756 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/e098b7eafd174a76a920cabd74b1518c as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/e098b7eafd174a76a920cabd74b1518c 2023-02-13 04:55:20,758 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/d05b8ad3e91b4da38d02507094745b02 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/d05b8ad3e91b4da38d02507094745b02 2023-02-13 04:55:20,759 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/e098b7eafd174a76a920cabd74b1518c, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 04:55:20,760 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8cb2fc4355445fe1dc5705702cd065d7 in 1248ms, sequenceid=17, compaction requested=true 2023-02-13 04:55:20,760 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:20,760 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:20,760 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:20,761 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/d05b8ad3e91b4da38d02507094745b02, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 04:55:20,762 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/2a44435d64fd4dd6a9a9c40202150f38 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/2a44435d64fd4dd6a9a9c40202150f38 2023-02-13 04:55:20,765 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/2a44435d64fd4dd6a9a9c40202150f38, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 04:55:20,766 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8937f228f64ed9a20627ea05b6572001 in 1254ms, sequenceid=17, compaction requested=true 2023-02-13 04:55:20,766 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:20,766 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:20,766 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:21,150 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/c96bcf8057cb4dcf97abb5a33aa6c506 2023-02-13 04:55:21,154 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/2b16bdf31e8c47d39baa16db6747d6bf as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/2b16bdf31e8c47d39baa16db6747d6bf 2023-02-13 04:55:21,157 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/2b16bdf31e8c47d39baa16db6747d6bf, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 04:55:21,158 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/c96bcf8057cb4dcf97abb5a33aa6c506 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/c96bcf8057cb4dcf97abb5a33aa6c506 2023-02-13 04:55:21,161 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/c96bcf8057cb4dcf97abb5a33aa6c506, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 04:55:21,162 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f959d9fe54998a7bac6e6957f0f0316c in 1650ms, sequenceid=17, compaction requested=true 2023-02-13 04:55:21,162 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:21,162 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:21,162 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:21,162 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:21,162 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,162 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 04:55:21,162 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 04:55:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:21,164 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:21,164 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:21,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 04:55:21,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@432c0c8a[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:21,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 04:55:21,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:21,166 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:21,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:21,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:21,166 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 04:55:21,166 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 04:55:21,166 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,167 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:21,166 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:21,168 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,168 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 04:55:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:21,168 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:21,168 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 04:55:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:21,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:21,170 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 04:55:21,170 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:21,170 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:21,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 04:55:21,170 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 04:55:21,170 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:21,172 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:21,172 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:21,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:21,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:21,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:21,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:21,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:21,172 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:21,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:21,173 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:21,174 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:21,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:21,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,175 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,175 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:21,176 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:21,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:21,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:21,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:21,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 04:55:21,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 04:55:21,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:21,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:21,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:21,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:21,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:21,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:21,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:21,176 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:21,176 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:21,176 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:21,276 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:21,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:21,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 04:55:21,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676264121287 (current time:1676264121287). 2023-02-13 04:55:21,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 04:55:21,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] zookeeper.ReadOnlyZKClient(139): Connect 0x05cc1b3e to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:55:21,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a72c807, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:55:21,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:55:21,300 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53634, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:55:21,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05cc1b3e to 127.0.0.1:54862 2023-02-13 04:55:21,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:21,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 04:55:21,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 04:55:21,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 04:55:21,310 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 04:55:21,311 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676264721311 2023-02-13 04:55:21,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 04:55:21,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676264121277 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 04:55:21,312 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 04:55:21,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 04:55:21,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-02-13 04:55:21,314 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 04:55:21,314 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676264721314 2023-02-13 04:55:21,316 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:21,316 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 04:55:21,416 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:21,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:21,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:55:21,421 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 04:55:21,621 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:21,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:21,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:55:21,622 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 04:55:21,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676264121277 2023-02-13 04:55:21,728 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676264121277' 2023-02-13 04:55:21,728 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:55:21,728 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676264121277' starting 'acquire' 2023-02-13 04:55:21,728 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676264121277', kicking off acquire phase on members. 2023-02-13 04:55:21,729 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676264121277 2023-02-13 04:55:21,729 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676264121277 2023-02-13 04:55:21,731 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:55:21,731 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:55:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:55:21,732 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,732 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676264121277 2023-02-13 04:55:21,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676264121277 2023-02-13 04:55:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 04:55:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676264121277 2023-02-13 04:55:21,732 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676264121277 from table testCompactionWithHFileLink type FLUSH 2023-02-13 04:55:21,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676264121277 2023-02-13 04:55:21,735 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676264121277' with timeout 300000ms 2023-02-13 04:55:21,735 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:55:21,735 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676264121277' starting 'acquire' stage 2023-02-13 04:55:21,735 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676264121277' locally acquired 2023-02-13 04:55:21,735 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (snaptb-1676264121277) in zk 2023-02-13 04:55:21,736 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,736 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676264121277 2023-02-13 04:55:21,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:21,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:55:21,736 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676264121277 2023-02-13 04:55:21,736 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676264121277' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:21,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676264121277 2023-02-13 04:55:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:21,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'snaptb-1676264121277' on coordinator 2023-02-13 04:55:21,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aa5a0b2[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:21,737 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676264121277' starting 'in-barrier' execution. 2023-02-13 04:55:21,737 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676264121277 2023-02-13 04:55:21,739 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676264121277 2023-02-13 04:55:21,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676264121277 2023-02-13 04:55:21,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676264121277 2023-02-13 04:55:21,739 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676264121277' received 'reached' from coordinator. 2023-02-13 04:55:21,739 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:21,739 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:21,739 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:21,740 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-13 04:55:21,740 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:21,740 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:21,740 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:55:21,740 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. started... 2023-02-13 04:55:21,740 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. started... 2023-02-13 04:55:21,740 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. started... 2023-02-13 04:55:21,740 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:21,740 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:21,740 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:21,741 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.' region-info for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,741 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.' region-info for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,741 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.' region-info for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,746 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:55:21,746 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:55:21,746 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:55:21,749 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/6bd7e96b2ec742048a2b78a87c1471ad, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/0417ff3fc0214f6c8d3f415d27e82bc8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/c98de4962b724fa6b1c5fe534e8d74b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/d05b8ad3e91b4da38d02507094745b02] hfiles 2023-02-13 04:55:21,749 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/f2763d4a860a422fbae6bddcda8ed99e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/d372afe1de784aec8b39d308768b70aa, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a315feb18b2849578e7ffdc931ed46be, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a62f3d4ab4f144ea90789a677febfe0d] hfiles 2023-02-13 04:55:21,749 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/f2763d4a860a422fbae6bddcda8ed99e for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,749 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/60547bad0bab4d8c862c6549201f3182, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8e96a6378c1b444e90d537320ed1a301, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/9bf697f7cee647f297ab393619709ad9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/2b16bdf31e8c47d39baa16db6747d6bf] hfiles 2023-02-13 04:55:21,749 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/6bd7e96b2ec742048a2b78a87c1471ad for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,750 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/60547bad0bab4d8c862c6549201f3182 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,895 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-13 04:55:21,895 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:55:21,895 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e1487dd to 127.0.0.1:54862 2023-02-13 04:55:21,895 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:21,896 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8e96a6378c1b444e90d537320ed1a301 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,896 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/d372afe1de784aec8b39d308768b70aa for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,896 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/9bf697f7cee647f297ab393619709ad9 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,896 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/0417ff3fc0214f6c8d3f415d27e82bc8 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/2b16bdf31e8c47d39baa16db6747d6bf for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,896 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a315feb18b2849578e7ffdc931ed46be for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/c98de4962b724fa6b1c5fe534e8d74b9 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a62f3d4ab4f144ea90789a677febfe0d for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/92bca81010524d70a4db84733e0dac74, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/35be733fbe06433690e053a6be9048a0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/bb73c7733dcc46b0887a90cadfde5987, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/c96bcf8057cb4dcf97abb5a33aa6c506] hfiles 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/bede7df0eb7a4fb19a6a3a86e279b7f8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/59b8e3a0514c42b4b36e2eb77f1f730d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/d827348a583044009ebfadcec6ea38b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/e098b7eafd174a76a920cabd74b1518c] hfiles 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/d05b8ad3e91b4da38d02507094745b02 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/bede7df0eb7a4fb19a6a3a86e279b7f8 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/59b8e3a0514c42b4b36e2eb77f1f730d for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/92bca81010524d70a4db84733e0dac74 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/d827348a583044009ebfadcec6ea38b9 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/c272a749b9b84b57af4555f49c0a879c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/947e710f0b6a4d8d8fee8c2a4464cd91, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/1340fb92dd5a45de80302444387bc5d2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/2a44435d64fd4dd6a9a9c40202150f38] hfiles 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/e098b7eafd174a76a920cabd74b1518c for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/35be733fbe06433690e053a6be9048a0 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/c272a749b9b84b57af4555f49c0a879c for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/bb73c7733dcc46b0887a90cadfde5987 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/c96bcf8057cb4dcf97abb5a33aa6c506 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/947e710f0b6a4d8d8fee8c2a4464cd91 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/1340fb92dd5a45de80302444387bc5d2 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,897 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/2a44435d64fd4dd6a9a9c40202150f38 for snapshot=snaptb-1676264121277 2023-02-13 04:55:21,906 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. completed. 2023-02-13 04:55:21,906 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:21,906 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. completed. 2023-02-13 04:55:21,906 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:21,907 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-13 04:55:21,907 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-13 04:55:21,922 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:55:21,923 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 04:55:22,308 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. completed. 2023-02-13 04:55:22,308 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:22,309 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-13 04:55:22,309 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-13 04:55:22,309 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,309 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676264121277' locally completed 2023-02-13 04:55:22,309 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676264121277' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676264121277' has notified controller of completion 2023-02-13 04:55:22,311 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676264121277' completed. 2023-02-13 04:55:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:55:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676264121277 2023-02-13 04:55:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676264121277 2023-02-13 04:55:22,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676264121277' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:22,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'snaptb-1676264121277', counting down latch. Waiting for 0 more 2023-02-13 04:55:22,313 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676264121277' execution completed 2023-02-13 04:55:22,313 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:22,313 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:22,313 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676264121277 2023-02-13 04:55:22,313 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676264121277including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 04:55:22,314 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676264121277 2023-02-13 04:55:22,314 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676264121277 2023-02-13 04:55:22,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676264121277 2023-02-13 04:55:22,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676264121277 2023-02-13 04:55:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676264121277 2023-02-13 04:55:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:55:22,315 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:55:22,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:55:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:55:22,315 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676264121277 2023-02-13 04:55:22,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676264121277 2023-02-13 04:55:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676264121277 2023-02-13 04:55:22,316 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676264121277 2023-02-13 04:55:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,318 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,318 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:55:22,318 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676264121277 2023-02-13 04:55:22,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:55:22,318 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676264121277 2023-02-13 04:55:22,318 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:22,318 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676264121277 2023-02-13 04:55:22,318 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:55:22,318 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-13 04:55:22,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1676264121277 because node does not exist (not an error) 2023-02-13 04:55:22,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676264121277 2023-02-13 04:55:22,318 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676264121277/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:22,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-13 04:55:22,318 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676264121277 2023-02-13 04:55:22,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:55:22,319 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676264121277 2023-02-13 04:55:22,319 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676264121277 2023-02-13 04:55:22,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:55:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213319c7c45e3944d1f995e98ce5d1400b4, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021347f6ad364105437790da65f217f632a8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fa2e16b102c04c29ab5b264265228241, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fb132639c629466691e84d7d939abd88, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130f9b57e163594b44a699ebe9a13a66e4, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302133772d2d49d094ab5859cff891286e3bd, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021348b3c1f2652541588c20bea476922c01, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138aa17bb4423d499c89e7f8a557cfd9c9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134cc030cdad9e4d628dc5f287960172bc, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213740cc6c27d6442e7af12f70600684ebe, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021379254681002e48f0be3ca5638e7b32fb, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a34d1e9cd76e46d88927a1609345925c] mob files 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213319c7c45e3944d1f995e98ce5d1400b4 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021347f6ad364105437790da65f217f632a8 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fa2e16b102c04c29ab5b264265228241 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fb132639c629466691e84d7d939abd88 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130f9b57e163594b44a699ebe9a13a66e4 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302133772d2d49d094ab5859cff891286e3bd 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021348b3c1f2652541588c20bea476922c01 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138aa17bb4423d499c89e7f8a557cfd9c9 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134cc030cdad9e4d628dc5f287960172bc 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213740cc6c27d6442e7af12f70600684ebe 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021379254681002e48f0be3ca5638e7b32fb 2023-02-13 04:55:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a34d1e9cd76e46d88927a1609345925c 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021328f2d0dcb6a048309c40b9c3e44ec9b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021359771b87577a44688abb450c6d04d082, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379a6fd4262434995969d00028b3dbc58, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213f0bf6eb2efdd455bbab991a87a25663c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021384526cf51294437ab50537734234504e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302138abc9e3c4d264a42a25b10d86dd9e0af, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213d1bc381dc2e1499199858718360e4a40, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eb2f8c20fc6f4dc098fc845f87a50bbe, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021333a3961b7d8e4b22b785ad398eedc1e8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302133b96764a6fad4e5882cd2dc0f1ef583b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138472c735c53845df86d0445ec6e6aba4, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c3ce0918c526415e8d0b4b4ac90c4fd0] mob files 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021328f2d0dcb6a048309c40b9c3e44ec9b9 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021359771b87577a44688abb450c6d04d082 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379a6fd4262434995969d00028b3dbc58 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213f0bf6eb2efdd455bbab991a87a25663c 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021384526cf51294437ab50537734234504e 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302138abc9e3c4d264a42a25b10d86dd9e0af 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213d1bc381dc2e1499199858718360e4a40 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eb2f8c20fc6f4dc098fc845f87a50bbe 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021333a3961b7d8e4b22b785ad398eedc1e8 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302133b96764a6fad4e5882cd2dc0f1ef583b 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138472c735c53845df86d0445ec6e6aba4 2023-02-13 04:55:22,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c3ce0918c526415e8d0b4b4ac90c4fd0 2023-02-13 04:55:22,423 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:22,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:22,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:55:22,424 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 04:55:22,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676264121277 2023-02-13 04:55:22,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/.tmp/snaptb-1676264121277 2023-02-13 04:55:23,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/.tmp/snaptb-1676264121277 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/snaptb-1676264121277 2023-02-13 04:55:23,424 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:23,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:23,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:55:23,425 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-13 04:55:23,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676264121277 of table testCompactionWithHFileLink completed 2023-02-13 04:55:23,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/.tmp/snaptb-1676264121277 2023-02-13 04:55:23,991 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/.tmp/snaptb-1676264121277 2023-02-13 04:55:23,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676264121277 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676264121311Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676264122726 (+1415 ms)Consolidate snapshot: snaptb-1676264121277 at 1676264122726Loading Region manifests for snaptb-1676264121277 at 1676264122727 (+1 ms)Writing data manifest for snaptb-1676264121277 at 1676264122736 (+9 ms)Verifying snapshot: snaptb-1676264121277 at 1676264123143 (+407 ms)Snapshot snaptb-1676264121277 of table testCompactionWithHFileLink completed at 1676264123990 (+847 ms) 2023-02-13 04:55:23,992 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 04:55:23,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.6800 sec 2023-02-13 04:55:24,150 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:55:25,425 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:25,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:25,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 04:55:25,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:25,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 04:55:25,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 04:55:25,457 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 04:55:25,457 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:25,457 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 04:55:25,457 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 04:55:25,457 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:25,457 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:25,464 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:25,464 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:25,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:25,465 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:25,465 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:25,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:25,465 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 04:55:25,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 04:55:25,466 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 04:55:25,466 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:25,466 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 04:55:25,466 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:25,466 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. started... 2023-02-13 04:55:25,466 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f959d9fe54998a7bac6e6957f0f0316c 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 04:55:25,466 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:25,466 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. started... 2023-02-13 04:55:25,466 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:25,466 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:25,466 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:25,467 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. started... 2023-02-13 04:55:25,466 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8cb2fc4355445fe1dc5705702cd065d7 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 04:55:25,467 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8937f228f64ed9a20627ea05b6572001 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 04:55:26,285 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/fb777069d7ab4b3da8cfae7a11373029 2023-02-13 04:55:26,285 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/5b14ce242d5d4cfaa0c980833fd0bea2 2023-02-13 04:55:26,286 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/a44bf6bf772e4282af353c9ef013f2cf 2023-02-13 04:55:26,289 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb777069d7ab4b3da8cfae7a11373029 2023-02-13 04:55:26,289 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b14ce242d5d4cfaa0c980833fd0bea2 2023-02-13 04:55:26,290 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a44bf6bf772e4282af353c9ef013f2cf 2023-02-13 04:55:27,106 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/952c27d018554eda81005c544fc93fb1 2023-02-13 04:55:27,106 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/b1b9996e9b0344729df005bfe942fe06 2023-02-13 04:55:27,107 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/d8f43403a2d94fc394d6e517306a4013 2023-02-13 04:55:27,110 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 952c27d018554eda81005c544fc93fb1 2023-02-13 04:55:27,110 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1b9996e9b0344729df005bfe942fe06 2023-02-13 04:55:27,110 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8f43403a2d94fc394d6e517306a4013 2023-02-13 04:55:27,111 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/a44bf6bf772e4282af353c9ef013f2cf as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a44bf6bf772e4282af353c9ef013f2cf 2023-02-13 04:55:27,111 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/5b14ce242d5d4cfaa0c980833fd0bea2 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/5b14ce242d5d4cfaa0c980833fd0bea2 2023-02-13 04:55:27,111 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/fb777069d7ab4b3da8cfae7a11373029 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/fb777069d7ab4b3da8cfae7a11373029 2023-02-13 04:55:27,118 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b14ce242d5d4cfaa0c980833fd0bea2 2023-02-13 04:55:27,118 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/5b14ce242d5d4cfaa0c980833fd0bea2, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 04:55:27,118 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb777069d7ab4b3da8cfae7a11373029 2023-02-13 04:55:27,118 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a44bf6bf772e4282af353c9ef013f2cf 2023-02-13 04:55:27,118 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/fb777069d7ab4b3da8cfae7a11373029, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 04:55:27,118 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a44bf6bf772e4282af353c9ef013f2cf, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 04:55:27,118 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/b1b9996e9b0344729df005bfe942fe06 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/b1b9996e9b0344729df005bfe942fe06 2023-02-13 04:55:27,119 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/952c27d018554eda81005c544fc93fb1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/952c27d018554eda81005c544fc93fb1 2023-02-13 04:55:27,119 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/d8f43403a2d94fc394d6e517306a4013 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/d8f43403a2d94fc394d6e517306a4013 2023-02-13 04:55:27,122 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1b9996e9b0344729df005bfe942fe06 2023-02-13 04:55:27,122 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/b1b9996e9b0344729df005bfe942fe06, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 04:55:27,122 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d8f43403a2d94fc394d6e517306a4013 2023-02-13 04:55:27,122 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 952c27d018554eda81005c544fc93fb1 2023-02-13 04:55:27,122 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/d8f43403a2d94fc394d6e517306a4013, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 04:55:27,123 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/952c27d018554eda81005c544fc93fb1, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 04:55:27,123 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8937f228f64ed9a20627ea05b6572001 in 1656ms, sequenceid=24, compaction requested=true 2023-02-13 04:55:27,123 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:27,123 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:27,123 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8cb2fc4355445fe1dc5705702cd065d7 in 1657ms, sequenceid=24, compaction requested=true 2023-02-13 04:55:27,123 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:27,123 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f959d9fe54998a7bac6e6957f0f0316c in 1657ms, sequenceid=24, compaction requested=true 2023-02-13 04:55:27,123 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:27,123 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:27,123 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:27,123 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:27,123 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:27,123 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:27,123 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:27,123 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,123 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 04:55:27,123 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 04:55:27,125 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:27,125 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:27,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:27,125 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:27,125 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:27,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:27,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:27,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:27,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:27,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 04:55:27,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1eb16e7c[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:27,126 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 04:55:27,127 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:27,130 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:27,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:27,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:27,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 04:55:27,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 04:55:27,131 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:27,131 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,131 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:27,132 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 04:55:27,132 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:27,132 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,132 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 04:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:27,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:27,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:27,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:27,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 04:55:27,134 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 04:55:27,134 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:27,134 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:27,134 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 04:55:27,134 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:27,136 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:27,136 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:27,136 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:27,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:27,136 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:27,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:27,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:27,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:27,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:27,137 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 04:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,140 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,140 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:27,140 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:27,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:27,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 04:55:27,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:27,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:27,140 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:27,140 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 04:55:27,140 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:27,140 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:27,140 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:27,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:27,141 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:27,141 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:27,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:27,141 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 04:55:27,141 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 04:55:27,241 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:27,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:27,242 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:27,242 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): f959d9fe54998a7bac6e6957f0f0316c/family1 is initiating major compaction (all files) 2023-02-13 04:55:27,242 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:27,242 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:27,243 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of f959d9fe54998a7bac6e6957f0f0316c/family1 in testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:27,243 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/60547bad0bab4d8c862c6549201f3182, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8e96a6378c1b444e90d537320ed1a301, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/9bf697f7cee647f297ab393619709ad9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/2b16bdf31e8c47d39baa16db6747d6bf, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/fb777069d7ab4b3da8cfae7a11373029] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp, totalSize=26.7 K 2023-02-13 04:55:27,243 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 60547bad0bab4d8c862c6549201f3182, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114135 2023-02-13 04:55:27,244 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 8e96a6378c1b444e90d537320ed1a301, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:27,244 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 9bf697f7cee647f297ab393619709ad9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:27,244 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 2b16bdf31e8c47d39baa16db6747d6bf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:27,245 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting fb777069d7ab4b3da8cfae7a11373029, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 04:55:27,258 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): f959d9fe54998a7bac6e6957f0f0316c#family1#compaction#107 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:27,665 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021333b6c535642e4e219d75e09e5bff65c8_del 2023-02-13 04:55:27,666 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021333b6c535642e4e219d75e09e5bff65c8_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021333b6c535642e4e219d75e09e5bff65c8_del 2023-02-13 04:55:28,478 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b98c901532f1497f911f60f934139b6f 2023-02-13 04:55:28,479 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/b98c901532f1497f911f60f934139b6f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/b98c901532f1497f911f60f934139b6f 2023-02-13 04:55:28,482 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b98c901532f1497f911f60f934139b6f 2023-02-13 04:55:28,483 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f959d9fe54998a7bac6e6957f0f0316c/family1 of f959d9fe54998a7bac6e6957f0f0316c into b98c901532f1497f911f60f934139b6f(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:28,483 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:28,483 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:28,484 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): f959d9fe54998a7bac6e6957f0f0316c/family2 is initiating major compaction (all files) 2023-02-13 04:55:28,484 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:28,484 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:28,484 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of f959d9fe54998a7bac6e6957f0f0316c/family2 in testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:28,484 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/92bca81010524d70a4db84733e0dac74, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/35be733fbe06433690e053a6be9048a0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/bb73c7733dcc46b0887a90cadfde5987, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/c96bcf8057cb4dcf97abb5a33aa6c506, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/d8f43403a2d94fc394d6e517306a4013] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp, totalSize=25.4 K 2023-02-13 04:55:28,484 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 92bca81010524d70a4db84733e0dac74, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114135 2023-02-13 04:55:28,485 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 35be733fbe06433690e053a6be9048a0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:28,485 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting bb73c7733dcc46b0887a90cadfde5987, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:28,485 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting c96bcf8057cb4dcf97abb5a33aa6c506, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:28,486 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting d8f43403a2d94fc394d6e517306a4013, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 04:55:28,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/60547bad0bab4d8c862c6549201f3182, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8e96a6378c1b444e90d537320ed1a301, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/9bf697f7cee647f297ab393619709ad9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/2b16bdf31e8c47d39baa16db6747d6bf, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/fb777069d7ab4b3da8cfae7a11373029] to archive 2023-02-13 04:55:28,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:28,496 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): f959d9fe54998a7bac6e6957f0f0316c#family2#compaction#108 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:28,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/60547bad0bab4d8c862c6549201f3182 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/60547bad0bab4d8c862c6549201f3182 2023-02-13 04:55:28,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8e96a6378c1b444e90d537320ed1a301 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8e96a6378c1b444e90d537320ed1a301 2023-02-13 04:55:28,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/9bf697f7cee647f297ab393619709ad9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/9bf697f7cee647f297ab393619709ad9 2023-02-13 04:55:28,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/2b16bdf31e8c47d39baa16db6747d6bf to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/2b16bdf31e8c47d39baa16db6747d6bf 2023-02-13 04:55:28,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/fb777069d7ab4b3da8cfae7a11373029 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/fb777069d7ab4b3da8cfae7a11373029 2023-02-13 04:55:28,906 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213eb8daf4c3428493b8a770b79778a414d_del 2023-02-13 04:55:28,906 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213eb8daf4c3428493b8a770b79778a414d_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb8daf4c3428493b8a770b79778a414d_del 2023-02-13 04:55:29,718 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4aab125d42f740c396470e2e160c0c28 2023-02-13 04:55:29,719 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/4aab125d42f740c396470e2e160c0c28 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/4aab125d42f740c396470e2e160c0c28 2023-02-13 04:55:29,723 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4aab125d42f740c396470e2e160c0c28 2023-02-13 04:55:29,723 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f959d9fe54998a7bac6e6957f0f0316c/family2 of f959d9fe54998a7bac6e6957f0f0316c into 4aab125d42f740c396470e2e160c0c28(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:29,724 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:29,724 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:29,724 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 8cb2fc4355445fe1dc5705702cd065d7/family1 is initiating major compaction (all files) 2023-02-13 04:55:29,724 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:29,724 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:29,724 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 8cb2fc4355445fe1dc5705702cd065d7/family1 in testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:29,724 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/f2763d4a860a422fbae6bddcda8ed99e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/d372afe1de784aec8b39d308768b70aa, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a315feb18b2849578e7ffdc931ed46be, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a62f3d4ab4f144ea90789a677febfe0d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a44bf6bf772e4282af353c9ef013f2cf] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp, totalSize=26.7 K 2023-02-13 04:55:29,724 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting f2763d4a860a422fbae6bddcda8ed99e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114137 2023-02-13 04:55:29,725 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting d372afe1de784aec8b39d308768b70aa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:29,725 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting a315feb18b2849578e7ffdc931ed46be, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:29,725 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting a62f3d4ab4f144ea90789a677febfe0d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:29,726 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting a44bf6bf772e4282af353c9ef013f2cf, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 04:55:29,735 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 8cb2fc4355445fe1dc5705702cd065d7#family1#compaction#109 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:29,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/92bca81010524d70a4db84733e0dac74, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/35be733fbe06433690e053a6be9048a0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/bb73c7733dcc46b0887a90cadfde5987, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/c96bcf8057cb4dcf97abb5a33aa6c506, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/d8f43403a2d94fc394d6e517306a4013] to archive 2023-02-13 04:55:29,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:29,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/92bca81010524d70a4db84733e0dac74 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/92bca81010524d70a4db84733e0dac74 2023-02-13 04:55:29,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/35be733fbe06433690e053a6be9048a0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/35be733fbe06433690e053a6be9048a0 2023-02-13 04:55:29,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/bb73c7733dcc46b0887a90cadfde5987 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/bb73c7733dcc46b0887a90cadfde5987 2023-02-13 04:55:29,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/c96bcf8057cb4dcf97abb5a33aa6c506 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/c96bcf8057cb4dcf97abb5a33aa6c506 2023-02-13 04:55:29,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/d8f43403a2d94fc394d6e517306a4013 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/d8f43403a2d94fc394d6e517306a4013 2023-02-13 04:55:30,142 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302130a690d1d62834eee841b78a16948672a_del 2023-02-13 04:55:30,142 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302130a690d1d62834eee841b78a16948672a_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130a690d1d62834eee841b78a16948672a_del 2023-02-13 04:55:30,956 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73b74c0e2ff54e839a4b4c408f7bdb7d 2023-02-13 04:55:30,957 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/73b74c0e2ff54e839a4b4c408f7bdb7d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/73b74c0e2ff54e839a4b4c408f7bdb7d 2023-02-13 04:55:30,960 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73b74c0e2ff54e839a4b4c408f7bdb7d 2023-02-13 04:55:30,961 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8cb2fc4355445fe1dc5705702cd065d7/family1 of 8cb2fc4355445fe1dc5705702cd065d7 into 73b74c0e2ff54e839a4b4c408f7bdb7d(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:30,961 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:30,961 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:30,961 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 8cb2fc4355445fe1dc5705702cd065d7/family2 is initiating major compaction (all files) 2023-02-13 04:55:30,961 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:30,961 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:30,962 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 8cb2fc4355445fe1dc5705702cd065d7/family2 in testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:30,962 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/bede7df0eb7a4fb19a6a3a86e279b7f8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/59b8e3a0514c42b4b36e2eb77f1f730d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/d827348a583044009ebfadcec6ea38b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/e098b7eafd174a76a920cabd74b1518c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/952c27d018554eda81005c544fc93fb1] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp, totalSize=25.4 K 2023-02-13 04:55:30,962 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting bede7df0eb7a4fb19a6a3a86e279b7f8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114137 2023-02-13 04:55:30,963 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 59b8e3a0514c42b4b36e2eb77f1f730d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:30,963 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting d827348a583044009ebfadcec6ea38b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:30,963 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting e098b7eafd174a76a920cabd74b1518c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:30,964 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 952c27d018554eda81005c544fc93fb1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 04:55:30,974 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 8cb2fc4355445fe1dc5705702cd065d7#family2#compaction#110 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:30,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/f2763d4a860a422fbae6bddcda8ed99e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/d372afe1de784aec8b39d308768b70aa, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a315feb18b2849578e7ffdc931ed46be, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a62f3d4ab4f144ea90789a677febfe0d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a44bf6bf772e4282af353c9ef013f2cf] to archive 2023-02-13 04:55:30,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:30,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/f2763d4a860a422fbae6bddcda8ed99e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/f2763d4a860a422fbae6bddcda8ed99e 2023-02-13 04:55:31,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/d372afe1de784aec8b39d308768b70aa to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/d372afe1de784aec8b39d308768b70aa 2023-02-13 04:55:31,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a315feb18b2849578e7ffdc931ed46be to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a315feb18b2849578e7ffdc931ed46be 2023-02-13 04:55:31,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a62f3d4ab4f144ea90789a677febfe0d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a62f3d4ab4f144ea90789a677febfe0d 2023-02-13 04:55:31,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a44bf6bf772e4282af353c9ef013f2cf to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/a44bf6bf772e4282af353c9ef013f2cf 2023-02-13 04:55:31,385 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213ace22b8399414cef8cca9d559640a78a_del 2023-02-13 04:55:31,385 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ace22b8399414cef8cca9d559640a78a_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213ace22b8399414cef8cca9d559640a78a_del 2023-02-13 04:55:32,199 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ea82962eee843ac996a7fc3b48d1540 2023-02-13 04:55:32,199 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/8ea82962eee843ac996a7fc3b48d1540 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/8ea82962eee843ac996a7fc3b48d1540 2023-02-13 04:55:32,203 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ea82962eee843ac996a7fc3b48d1540 2023-02-13 04:55:32,204 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8cb2fc4355445fe1dc5705702cd065d7/family2 of 8cb2fc4355445fe1dc5705702cd065d7 into 8ea82962eee843ac996a7fc3b48d1540(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:32,204 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:32,204 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:32,204 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 8937f228f64ed9a20627ea05b6572001/family1 is initiating major compaction (all files) 2023-02-13 04:55:32,204 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:32,204 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:32,204 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 8937f228f64ed9a20627ea05b6572001/family1 in testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:32,204 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/6bd7e96b2ec742048a2b78a87c1471ad, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/0417ff3fc0214f6c8d3f415d27e82bc8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/c98de4962b724fa6b1c5fe534e8d74b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/d05b8ad3e91b4da38d02507094745b02, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/5b14ce242d5d4cfaa0c980833fd0bea2] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp, totalSize=26.7 K 2023-02-13 04:55:32,205 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 6bd7e96b2ec742048a2b78a87c1471ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114136 2023-02-13 04:55:32,205 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 0417ff3fc0214f6c8d3f415d27e82bc8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:32,206 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting c98de4962b724fa6b1c5fe534e8d74b9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:32,206 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting d05b8ad3e91b4da38d02507094745b02, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:32,206 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 5b14ce242d5d4cfaa0c980833fd0bea2, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 04:55:32,216 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 8937f228f64ed9a20627ea05b6572001#family1#compaction#111 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:32,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/bede7df0eb7a4fb19a6a3a86e279b7f8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/59b8e3a0514c42b4b36e2eb77f1f730d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/d827348a583044009ebfadcec6ea38b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/e098b7eafd174a76a920cabd74b1518c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/952c27d018554eda81005c544fc93fb1] to archive 2023-02-13 04:55:32,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:32,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/bede7df0eb7a4fb19a6a3a86e279b7f8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/bede7df0eb7a4fb19a6a3a86e279b7f8 2023-02-13 04:55:32,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/59b8e3a0514c42b4b36e2eb77f1f730d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/59b8e3a0514c42b4b36e2eb77f1f730d 2023-02-13 04:55:32,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/d827348a583044009ebfadcec6ea38b9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/d827348a583044009ebfadcec6ea38b9 2023-02-13 04:55:32,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/e098b7eafd174a76a920cabd74b1518c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/e098b7eafd174a76a920cabd74b1518c 2023-02-13 04:55:32,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/952c27d018554eda81005c544fc93fb1 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/952c27d018554eda81005c544fc93fb1 2023-02-13 04:55:32,624 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213f037994fb942497bab7bff490801fea3_del 2023-02-13 04:55:32,624 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213f037994fb942497bab7bff490801fea3_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213f037994fb942497bab7bff490801fea3_del 2023-02-13 04:55:33,436 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82af7af57ad8406e85da2dd803d5b55f 2023-02-13 04:55:33,437 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/82af7af57ad8406e85da2dd803d5b55f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/82af7af57ad8406e85da2dd803d5b55f 2023-02-13 04:55:33,441 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82af7af57ad8406e85da2dd803d5b55f 2023-02-13 04:55:33,442 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8937f228f64ed9a20627ea05b6572001/family1 of 8937f228f64ed9a20627ea05b6572001 into 82af7af57ad8406e85da2dd803d5b55f(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:33,442 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:33,442 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:33,442 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 8937f228f64ed9a20627ea05b6572001/family2 is initiating major compaction (all files) 2023-02-13 04:55:33,442 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:33,442 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:33,442 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 8937f228f64ed9a20627ea05b6572001/family2 in testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:33,443 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/c272a749b9b84b57af4555f49c0a879c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/947e710f0b6a4d8d8fee8c2a4464cd91, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/1340fb92dd5a45de80302444387bc5d2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/2a44435d64fd4dd6a9a9c40202150f38, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/b1b9996e9b0344729df005bfe942fe06] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp, totalSize=25.4 K 2023-02-13 04:55:33,443 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting c272a749b9b84b57af4555f49c0a879c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114136 2023-02-13 04:55:33,443 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 947e710f0b6a4d8d8fee8c2a4464cd91, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:33,444 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 1340fb92dd5a45de80302444387bc5d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:33,444 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 2a44435d64fd4dd6a9a9c40202150f38, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:33,444 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting b1b9996e9b0344729df005bfe942fe06, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 04:55:33,457 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 8937f228f64ed9a20627ea05b6572001#family2#compaction#112 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:33,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/6bd7e96b2ec742048a2b78a87c1471ad, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/0417ff3fc0214f6c8d3f415d27e82bc8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/c98de4962b724fa6b1c5fe534e8d74b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/d05b8ad3e91b4da38d02507094745b02, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/5b14ce242d5d4cfaa0c980833fd0bea2] to archive 2023-02-13 04:55:33,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:33,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/6bd7e96b2ec742048a2b78a87c1471ad to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/6bd7e96b2ec742048a2b78a87c1471ad 2023-02-13 04:55:33,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/0417ff3fc0214f6c8d3f415d27e82bc8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/0417ff3fc0214f6c8d3f415d27e82bc8 2023-02-13 04:55:33,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/c98de4962b724fa6b1c5fe534e8d74b9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/c98de4962b724fa6b1c5fe534e8d74b9 2023-02-13 04:55:33,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/d05b8ad3e91b4da38d02507094745b02 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/d05b8ad3e91b4da38d02507094745b02 2023-02-13 04:55:33,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/5b14ce242d5d4cfaa0c980833fd0bea2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/5b14ce242d5d4cfaa0c980833fd0bea2 2023-02-13 04:55:33,865 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021372235ebdc51c4ae5839ac57f7ce1897b_del 2023-02-13 04:55:33,865 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021372235ebdc51c4ae5839ac57f7ce1897b_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021372235ebdc51c4ae5839ac57f7ce1897b_del 2023-02-13 04:55:34,678 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e1409980f8943c2b6dfe718fdeef078 2023-02-13 04:55:34,679 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/6e1409980f8943c2b6dfe718fdeef078 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/6e1409980f8943c2b6dfe718fdeef078 2023-02-13 04:55:34,682 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e1409980f8943c2b6dfe718fdeef078 2023-02-13 04:55:34,683 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8937f228f64ed9a20627ea05b6572001/family2 of 8937f228f64ed9a20627ea05b6572001 into 6e1409980f8943c2b6dfe718fdeef078(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:34,683 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:34,688 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:34,691 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:34,695 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:34,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/c272a749b9b84b57af4555f49c0a879c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/947e710f0b6a4d8d8fee8c2a4464cd91, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/1340fb92dd5a45de80302444387bc5d2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/2a44435d64fd4dd6a9a9c40202150f38, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/b1b9996e9b0344729df005bfe942fe06] to archive 2023-02-13 04:55:34,696 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:34,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:34,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/c272a749b9b84b57af4555f49c0a879c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/c272a749b9b84b57af4555f49c0a879c 2023-02-13 04:55:34,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/947e710f0b6a4d8d8fee8c2a4464cd91 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/947e710f0b6a4d8d8fee8c2a4464cd91 2023-02-13 04:55:34,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/1340fb92dd5a45de80302444387bc5d2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/1340fb92dd5a45de80302444387bc5d2 2023-02-13 04:55:34,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/2a44435d64fd4dd6a9a9c40202150f38 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/2a44435d64fd4dd6a9a9c40202150f38 2023-02-13 04:55:34,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/b1b9996e9b0344729df005bfe942fe06 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/b1b9996e9b0344729df005bfe942fe06 2023-02-13 04:55:34,716 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 04:55:34,748 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 04:55:34,751 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021333b6c535642e4e219d75e09e5bff65c8_del 2023-02-13 04:55:34,753 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213f037994fb942497bab7bff490801fea3_del 2023-02-13 04:55:34,756 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302130a690d1d62834eee841b78a16948672a_del 2023-02-13 04:55:34,756 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:34,756 DEBUG [Listener at localhost/37751] zookeeper.ReadOnlyZKClient(139): Connect 0x357debea to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:55:34,762 DEBUG [Listener at localhost/37751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@662cdd77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:55:34,762 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:34,763 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:34,763 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:34,819 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302132d82d12cc7564a2e83773295cef962f1 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132d82d12cc7564a2e83773295cef962f1 2023-02-13 04:55:34,820 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:34,839 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:55:34,843 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41288, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:55:34,849 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:55:34,850 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:55:34,858 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/59f960c30132407db057aa279beed528 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 04:55:34,859 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/59f960c30132407db057aa279beed528}] 2023-02-13 04:55:34,862 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/59f960c30132407db057aa279beed528 for inclusion in f959d9fe54998a7bac6e6957f0f0316c/family1 2023-02-13 04:55:34,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 04:55:34,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 04:55:34,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:34,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/59f960c30132407db057aa279beed528 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__pdois7hipoifobvklteqdrktorlr706585mhgkb1i2jreuf1sc95ppkpco0i7a1j/family1/59f960c30132407db057aa279beed528 2023-02-13 04:55:34,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__pdois7hipoifobvklteqdrktorlr706585mhgkb1i2jreuf1sc95ppkpco0i7a1j/family1/59f960c30132407db057aa279beed528 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8a153f3e5fcb481ebd21e3ca355b7e30_SeqId_29_ 2023-02-13 04:55:34,868 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__pdois7hipoifobvklteqdrktorlr706585mhgkb1i2jreuf1sc95ppkpco0i7a1j/family1/59f960c30132407db057aa279beed528 into f959d9fe54998a7bac6e6957f0f0316c/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8a153f3e5fcb481ebd21e3ca355b7e30_SeqId_29_ - updating store file list. 2023-02-13 04:55:34,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8a153f3e5fcb481ebd21e3ca355b7e30_SeqId_29_ into f959d9fe54998a7bac6e6957f0f0316c/family1 2023-02-13 04:55:34,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__pdois7hipoifobvklteqdrktorlr706585mhgkb1i2jreuf1sc95ppkpco0i7a1j/family1/59f960c30132407db057aa279beed528 into f959d9fe54998a7bac6e6957f0f0316c/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8a153f3e5fcb481ebd21e3ca355b7e30_SeqId_29_) 2023-02-13 04:55:34,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__pdois7hipoifobvklteqdrktorlr706585mhgkb1i2jreuf1sc95ppkpco0i7a1j/family1/59f960c30132407db057aa279beed528 2023-02-13 04:55:34,873 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:34,873 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:34,874 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134cc030cdad9e4d628dc5f287960172bc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302134cc030cdad9e4d628dc5f287960172bc 2023-02-13 04:55:34,875 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213740cc6c27d6442e7af12f70600684ebe to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213740cc6c27d6442e7af12f70600684ebe 2023-02-13 04:55:34,876 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021379254681002e48f0be3ca5638e7b32fb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021379254681002e48f0be3ca5638e7b32fb 2023-02-13 04:55:34,877 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a34d1e9cd76e46d88927a1609345925c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213a34d1e9cd76e46d88927a1609345925c 2023-02-13 04:55:34,877 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 04:55:34,877 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 04:55:34,878 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:35,221 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021380952787781d4a319c380ef2fa55027e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021380952787781d4a319c380ef2fa55027e 2023-02-13 04:55:35,221 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:35,247 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/f6c7a672d1d24e6398155512b741d948 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 04:55:35,249 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/f6c7a672d1d24e6398155512b741d948}] 2023-02-13 04:55:35,252 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/f6c7a672d1d24e6398155512b741d948 for inclusion in 8937f228f64ed9a20627ea05b6572001/family1 2023-02-13 04:55:35,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 04:55:35,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 04:55:35,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:35,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/f6c7a672d1d24e6398155512b741d948 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ecgg2bkoihsvvgo0a5um9r7eliup4cma6ra3bgcg2dvj9960t5ho3pkdolk12u5h/family1/f6c7a672d1d24e6398155512b741d948 2023-02-13 04:55:35,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ecgg2bkoihsvvgo0a5um9r7eliup4cma6ra3bgcg2dvj9960t5ho3pkdolk12u5h/family1/f6c7a672d1d24e6398155512b741d948 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/64ba305132d54a408039e1bc304b7cbe_SeqId_29_ 2023-02-13 04:55:35,257 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ecgg2bkoihsvvgo0a5um9r7eliup4cma6ra3bgcg2dvj9960t5ho3pkdolk12u5h/family1/f6c7a672d1d24e6398155512b741d948 into 8937f228f64ed9a20627ea05b6572001/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/64ba305132d54a408039e1bc304b7cbe_SeqId_29_ - updating store file list. 2023-02-13 04:55:35,260 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/64ba305132d54a408039e1bc304b7cbe_SeqId_29_ into 8937f228f64ed9a20627ea05b6572001/family1 2023-02-13 04:55:35,260 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ecgg2bkoihsvvgo0a5um9r7eliup4cma6ra3bgcg2dvj9960t5ho3pkdolk12u5h/family1/f6c7a672d1d24e6398155512b741d948 into 8937f228f64ed9a20627ea05b6572001/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/64ba305132d54a408039e1bc304b7cbe_SeqId_29_) 2023-02-13 04:55:35,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ecgg2bkoihsvvgo0a5um9r7eliup4cma6ra3bgcg2dvj9960t5ho3pkdolk12u5h/family1/f6c7a672d1d24e6398155512b741d948 2023-02-13 04:55:35,262 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:35,262 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:35,263 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213319c7c45e3944d1f995e98ce5d1400b4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213319c7c45e3944d1f995e98ce5d1400b4 2023-02-13 04:55:35,264 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021347f6ad364105437790da65f217f632a8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021347f6ad364105437790da65f217f632a8 2023-02-13 04:55:35,265 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fa2e16b102c04c29ab5b264265228241 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fa2e16b102c04c29ab5b264265228241 2023-02-13 04:55:35,266 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fb132639c629466691e84d7d939abd88 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213fb132639c629466691e84d7d939abd88 2023-02-13 04:55:35,266 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 04:55:35,266 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 04:55:35,267 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:35,620 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213826f21c9478e405ca2592a14092fe7ce to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213826f21c9478e405ca2592a14092fe7ce 2023-02-13 04:55:35,621 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:35,643 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/e6cf259acb7c4533888732ba0b2cdaa4 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 04:55:35,643 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/e6cf259acb7c4533888732ba0b2cdaa4}] 2023-02-13 04:55:35,646 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/e6cf259acb7c4533888732ba0b2cdaa4 for inclusion in 8cb2fc4355445fe1dc5705702cd065d7/family1 2023-02-13 04:55:35,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 04:55:35,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 04:55:35,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:35,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/e6cf259acb7c4533888732ba0b2cdaa4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ncre21htuh9c5sd5vtnqatcuhanc4aro900ef2hu90iflvd5hglbfaj1ariku89d/family1/e6cf259acb7c4533888732ba0b2cdaa4 2023-02-13 04:55:35,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ncre21htuh9c5sd5vtnqatcuhanc4aro900ef2hu90iflvd5hglbfaj1ariku89d/family1/e6cf259acb7c4533888732ba0b2cdaa4 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5a9923c5c0814149962a041496b7cc5a_SeqId_29_ 2023-02-13 04:55:35,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ncre21htuh9c5sd5vtnqatcuhanc4aro900ef2hu90iflvd5hglbfaj1ariku89d/family1/e6cf259acb7c4533888732ba0b2cdaa4 into 8cb2fc4355445fe1dc5705702cd065d7/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5a9923c5c0814149962a041496b7cc5a_SeqId_29_ - updating store file list. 2023-02-13 04:55:35,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5a9923c5c0814149962a041496b7cc5a_SeqId_29_ into 8cb2fc4355445fe1dc5705702cd065d7/family1 2023-02-13 04:55:35,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ncre21htuh9c5sd5vtnqatcuhanc4aro900ef2hu90iflvd5hglbfaj1ariku89d/family1/e6cf259acb7c4533888732ba0b2cdaa4 into 8cb2fc4355445fe1dc5705702cd065d7/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5a9923c5c0814149962a041496b7cc5a_SeqId_29_) 2023-02-13 04:55:35,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__ncre21htuh9c5sd5vtnqatcuhanc4aro900ef2hu90iflvd5hglbfaj1ariku89d/family1/e6cf259acb7c4533888732ba0b2cdaa4 2023-02-13 04:55:35,656 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:35,656 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:35,657 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130f9b57e163594b44a699ebe9a13a66e4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130f9b57e163594b44a699ebe9a13a66e4 2023-02-13 04:55:35,658 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302133772d2d49d094ab5859cff891286e3bd to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302133772d2d49d094ab5859cff891286e3bd 2023-02-13 04:55:35,659 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021348b3c1f2652541588c20bea476922c01 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021348b3c1f2652541588c20bea476922c01 2023-02-13 04:55:35,659 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138aa17bb4423d499c89e7f8a557cfd9c9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138aa17bb4423d499c89e7f8a557cfd9c9 2023-02-13 04:55:35,660 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 04:55:35,660 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 04:55:35,660 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:35,660 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:35,660 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:35,660 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021333b6c535642e4e219d75e09e5bff65c8_del] 2023-02-13 04:55:35,661 DEBUG [Listener at localhost/37751] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:35,661 DEBUG [Listener at localhost/37751] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021333b6c535642e4e219d75e09e5bff65c8_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021333b6c535642e4e219d75e09e5bff65c8_del 2023-02-13 04:55:35,662 INFO [Listener at localhost/37751] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 04:55:35,662 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213f037994fb942497bab7bff490801fea3_del] 2023-02-13 04:55:35,662 DEBUG [Listener at localhost/37751] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:35,663 DEBUG [Listener at localhost/37751] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213f037994fb942497bab7bff490801fea3_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213f037994fb942497bab7bff490801fea3_del 2023-02-13 04:55:35,663 INFO [Listener at localhost/37751] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 04:55:35,663 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130a690d1d62834eee841b78a16948672a_del] 2023-02-13 04:55:35,663 DEBUG [Listener at localhost/37751] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:35,664 DEBUG [Listener at localhost/37751] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130a690d1d62834eee841b78a16948672a_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302130a690d1d62834eee841b78a16948672a_del 2023-02-13 04:55:35,664 INFO [Listener at localhost/37751] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 04:55:35,667 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:35,668 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:35,671 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:35,671 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:35,676 INFO [Listener at localhost/37751] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-13 04:55:35,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-02-13 04:55:35,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-13 04:55:35,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 04:55:35,679 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264135679"}]},"ts":"1676264135679"} 2023-02-13 04:55:35,680 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-13 04:55:35,682 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-13 04:55:35,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, UNASSIGN}] 2023-02-13 04:55:35,684 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, UNASSIGN 2023-02-13 04:55:35,684 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, UNASSIGN 2023-02-13 04:55:35,684 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, UNASSIGN 2023-02-13 04:55:35,684 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=8937f228f64ed9a20627ea05b6572001, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:35,684 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f959d9fe54998a7bac6e6957f0f0316c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:35,684 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264135684"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264135684"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264135684"}]},"ts":"1676264135684"} 2023-02-13 04:55:35,684 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8cb2fc4355445fe1dc5705702cd065d7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:35,684 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264135684"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264135684"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264135684"}]},"ts":"1676264135684"} 2023-02-13 04:55:35,685 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264135684"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264135684"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264135684"}]},"ts":"1676264135684"} 2023-02-13 04:55:35,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 8937f228f64ed9a20627ea05b6572001, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:35,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure f959d9fe54998a7bac6e6957f0f0316c, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:35,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 8cb2fc4355445fe1dc5705702cd065d7, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:35,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 04:55:35,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:35,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8937f228f64ed9a20627ea05b6572001, disabling compactions & flushes 2023-02-13 04:55:35,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:35,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:35,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. after waiting 0 ms 2023-02-13 04:55:35,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:35,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 04:55:35,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:35,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8937f228f64ed9a20627ea05b6572001: Waiting for close lock at 1676264135837Running coprocessor pre-close hooks at 1676264135837Disabling compacts and flushes for region at 1676264135837Disabling writes for close at 1676264135837Writing region close event to WAL at 1676264135838 (+1 ms)Running coprocessor post-close hooks at 1676264135842 (+4 ms)Closed at 1676264135842 2023-02-13 04:55:35,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:35,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:35,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8cb2fc4355445fe1dc5705702cd065d7, disabling compactions & flushes 2023-02-13 04:55:35,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:35,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:35,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. after waiting 0 ms 2023-02-13 04:55:35,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:35,844 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=8937f228f64ed9a20627ea05b6572001, regionState=CLOSED 2023-02-13 04:55:35,844 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264135844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264135844"}]},"ts":"1676264135844"} 2023-02-13 04:55:35,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-02-13 04:55:35,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 8937f228f64ed9a20627ea05b6572001, server=jenkins-hbase4.apache.org,37513,1676264019660 in 161 msec 2023-02-13 04:55:35,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 04:55:35,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, UNASSIGN in 165 msec 2023-02-13 04:55:35,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:35,849 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8cb2fc4355445fe1dc5705702cd065d7: Waiting for close lock at 1676264135844Running coprocessor pre-close hooks at 1676264135844Disabling compacts and flushes for region at 1676264135844Disabling writes for close at 1676264135844Writing region close event to WAL at 1676264135845 (+1 ms)Running coprocessor post-close hooks at 1676264135848 (+3 ms)Closed at 1676264135849 (+1 ms) 2023-02-13 04:55:35,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:35,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:35,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f959d9fe54998a7bac6e6957f0f0316c, disabling compactions & flushes 2023-02-13 04:55:35,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:35,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:35,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. after waiting 0 ms 2023-02-13 04:55:35,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:35,850 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8cb2fc4355445fe1dc5705702cd065d7, regionState=CLOSED 2023-02-13 04:55:35,850 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264135850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264135850"}]},"ts":"1676264135850"} 2023-02-13 04:55:35,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-02-13 04:55:35,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 8cb2fc4355445fe1dc5705702cd065d7, server=jenkins-hbase4.apache.org,37513,1676264019660 in 165 msec 2023-02-13 04:55:35,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, UNASSIGN in 171 msec 2023-02-13 04:55:35,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 04:55:35,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:35,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f959d9fe54998a7bac6e6957f0f0316c: Waiting for close lock at 1676264135850Running coprocessor pre-close hooks at 1676264135850Disabling compacts and flushes for region at 1676264135850Disabling writes for close at 1676264135850Writing region close event to WAL at 1676264135851 (+1 ms)Running coprocessor post-close hooks at 1676264135854 (+3 ms)Closed at 1676264135854 2023-02-13 04:55:35,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:35,856 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f959d9fe54998a7bac6e6957f0f0316c, regionState=CLOSED 2023-02-13 04:55:35,856 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264135856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264135856"}]},"ts":"1676264135856"} 2023-02-13 04:55:35,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-02-13 04:55:35,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure f959d9fe54998a7bac6e6957f0f0316c, server=jenkins-hbase4.apache.org,37513,1676264019660 in 171 msec 2023-02-13 04:55:35,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-02-13 04:55:35,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, UNASSIGN in 176 msec 2023-02-13 04:55:35,859 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264135859"}]},"ts":"1676264135859"} 2023-02-13 04:55:35,860 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-13 04:55:35,861 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-13 04:55:35,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 186 msec 2023-02-13 04:55:35,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 04:55:35,981 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-13 04:55:35,991 INFO [Listener at localhost/37751] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676264121277-1676264135991 2023-02-13 04:55:35,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 04:55:35,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676264135992 (current time:1676264135992). 2023-02-13 04:55:35,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 04:55:35,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] zookeeper.ReadOnlyZKClient(139): Connect 0x1f9c8e5c to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:55:36,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64377b82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:55:36,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:55:36,004 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41302, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:55:36,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f9c8e5c to 127.0.0.1:54862 2023-02-13 04:55:36,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:36,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 04:55:36,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 04:55:36,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 04:55:36,008 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 04:55:36,009 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676264736009 2023-02-13 04:55:36,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 04:55:36,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676264121277-1676264135991 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 04:55:36,009 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:36,009 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 04:55:36,109 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:36,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:36,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:55:36,110 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 04:55:36,311 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:36,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:36,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:55:36,312 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 04:55:36,415 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-13 04:55:36,416 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 04:55:36,416 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 04:55:36,417 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 04:55:36,417 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 04:55:36,417 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 04:55:36,417 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 04:55:36,417 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 04:55:36,417 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 04:55:36,419 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/64ba305132d54a408039e1bc304b7cbe_SeqId_29_, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/82af7af57ad8406e85da2dd803d5b55f] hfiles 2023-02-13 04:55:36,419 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/64ba305132d54a408039e1bc304b7cbe_SeqId_29_ 2023-02-13 04:55:36,419 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5a9923c5c0814149962a041496b7cc5a_SeqId_29_, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/73b74c0e2ff54e839a4b4c408f7bdb7d] hfiles 2023-02-13 04:55:36,419 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021380952787781d4a319c380ef2fa55027e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213826f21c9478e405ca2592a14092fe7ce, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132d82d12cc7564a2e83773295cef962f1] hfiles 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5a9923c5c0814149962a041496b7cc5a_SeqId_29_ 2023-02-13 04:55:36,419 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/82af7af57ad8406e85da2dd803d5b55f 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/73b74c0e2ff54e839a4b4c408f7bdb7d 2023-02-13 04:55:36,419 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8a153f3e5fcb481ebd21e3ca355b7e30_SeqId_29_, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/b98c901532f1497f911f60f934139b6f] hfiles 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021380952787781d4a319c380ef2fa55027e 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8a153f3e5fcb481ebd21e3ca355b7e30_SeqId_29_ 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213826f21c9478e405ca2592a14092fe7ce 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/b98c901532f1497f911f60f934139b6f 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132d82d12cc7564a2e83773295cef962f1 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/6e1409980f8943c2b6dfe718fdeef078] hfiles 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/6e1409980f8943c2b6dfe718fdeef078 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/4aab125d42f740c396470e2e160c0c28] hfiles 2023-02-13 04:55:36,421 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/4aab125d42f740c396470e2e160c0c28 2023-02-13 04:55:36,420 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/8ea82962eee843ac996a7fc3b48d1540] hfiles 2023-02-13 04:55:36,421 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/8ea82962eee843ac996a7fc3b48d1540 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021328f2d0dcb6a048309c40b9c3e44ec9b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021359771b87577a44688abb450c6d04d082, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021372235ebdc51c4ae5839ac57f7ce1897b_del, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379a6fd4262434995969d00028b3dbc58, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213f0bf6eb2efdd455bbab991a87a25663c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021384526cf51294437ab50537734234504e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302138abc9e3c4d264a42a25b10d86dd9e0af, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213ace22b8399414cef8cca9d559640a78a_del, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213d1bc381dc2e1499199858718360e4a40, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eb2f8c20fc6f4dc098fc845f87a50bbe, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021333a3961b7d8e4b22b785ad398eedc1e8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302133b96764a6fad4e5882cd2dc0f1ef583b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138472c735c53845df86d0445ec6e6aba4, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c3ce0918c526415e8d0b4b4ac90c4fd0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb8daf4c3428493b8a770b79778a414d_del] hfiles 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021328f2d0dcb6a048309c40b9c3e44ec9b9 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021359771b87577a44688abb450c6d04d082 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021372235ebdc51c4ae5839ac57f7ce1897b_del 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021379a6fd4262434995969d00028b3dbc58 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213f0bf6eb2efdd455bbab991a87a25663c 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021384526cf51294437ab50537734234504e 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302138abc9e3c4d264a42a25b10d86dd9e0af 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213ace22b8399414cef8cca9d559640a78a_del 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213d1bc381dc2e1499199858718360e4a40 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eb2f8c20fc6f4dc098fc845f87a50bbe 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021333a3961b7d8e4b22b785ad398eedc1e8 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302133b96764a6fad4e5882cd2dc0f1ef583b 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138472c735c53845df86d0445ec6e6aba4 2023-02-13 04:55:36,426 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c3ce0918c526415e8d0b4b4ac90c4fd0 2023-02-13 04:55:36,427 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb8daf4c3428493b8a770b79778a414d_del 2023-02-13 04:55:36,612 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:36,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:36,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:55:36,613 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 04:55:36,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-13 04:55:36,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676264121277-1676264135991 2023-02-13 04:55:36,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676264121277-1676264135991 2023-02-13 04:55:37,113 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:37,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:37,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:55:37,114 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 04:55:37,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676264121277-1676264135991 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/hbase-failsafe-snaptb-1676264121277-1676264135991 2023-02-13 04:55:38,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676264121277-1676264135991 of table testCompactionWithHFileLink completed 2023-02-13 04:55:38,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676264121277-1676264135991 2023-02-13 04:55:38,070 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676264121277-1676264135991 2023-02-13 04:55:38,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676264121277-1676264135991 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676264136009Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676264136415 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676264121277-1676264135991 at 1676264136834 (+419 ms)Loading Region manifests for hbase-failsafe-snaptb-1676264121277-1676264135991 at 1676264136835 (+1 ms)Writing data manifest for hbase-failsafe-snaptb-1676264121277-1676264135991 at 1676264136837 (+2 ms)Verifying snapshot: hbase-failsafe-snaptb-1676264121277-1676264135991 at 1676264137243 (+406 ms)Snapshot hbase-failsafe-snaptb-1676264121277-1676264135991 of table testCompactionWithHFileLink completed at 1676264138069 (+826 ms) 2023-02-13 04:55:38,071 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 04:55:38,072 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0640 sec 2023-02-13 04:55:38,114 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:55:38,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 04:55:38,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676264121277-1676264135991 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 04:55:38,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676264121277" table: "testCompactionWithHFileLink" creation_time: 1676264121287 type: FLUSH version: 2 ttl: 0 ) 2023-02-13 04:55:38,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676264121277 as table=testCompactionWithHFileLink 2023-02-13 04:55:38,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 04:55:38,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 04:55:38,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 04:55:38,561 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 04:55:38,562 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 04:55:38,562 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 04:55:38,562 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 04:55:38,567 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676264121277" table: "testCompactionWithHFileLink" creation_time: 1676264121287 type: FLUSH version: 2 ttl: 0 2023-02-13 04:55:38,567 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink 2023-02-13 04:55:38,572 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-13 04:55:38,575 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213826f21c9478e405ca2592a14092fe7ce to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213826f21c9478e405ca2592a14092fe7ce 2023-02-13 04:55:38,577 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132d82d12cc7564a2e83773295cef962f1 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132d82d12cc7564a2e83773295cef962f1 2023-02-13 04:55:38,578 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021380952787781d4a319c380ef2fa55027e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021380952787781d4a319c380ef2fa55027e 2023-02-13 04:55:38,578 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213319c7c45e3944d1f995e98ce5d1400b4 of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,581 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023021347f6ad364105437790da65f217f632a8 of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,583 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213fa2e16b102c04c29ab5b264265228241 of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,585 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213fb132639c629466691e84d7d939abd88 of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,588 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302130f9b57e163594b44a699ebe9a13a66e4 of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,590 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302133772d2d49d094ab5859cff891286e3bd of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,593 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023021348b3c1f2652541588c20bea476922c01 of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,596 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302138aa17bb4423d499c89e7f8a557cfd9c9 of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,599 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302134cc030cdad9e4d628dc5f287960172bc of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,602 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213740cc6c27d6442e7af12f70600684ebe of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,605 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023021379254681002e48f0be3ca5638e7b32fb of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,608 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213a34d1e9cd76e46d88927a1609345925c of snapshot=snaptb-1676264121277 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 04:55:38,612 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb8daf4c3428493b8a770b79778a414d_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb8daf4c3428493b8a770b79778a414d_del 2023-02-13 04:55:38,613 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021372235ebdc51c4ae5839ac57f7ce1897b_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021372235ebdc51c4ae5839ac57f7ce1897b_del 2023-02-13 04:55:38,614 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213ace22b8399414cef8cca9d559640a78a_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213ace22b8399414cef8cca9d559640a78a_del 2023-02-13 04:55:38,614 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:38,614 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:38,614 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:38,618 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/64ba305132d54a408039e1bc304b7cbe_SeqId_29_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/64ba305132d54a408039e1bc304b7cbe_SeqId_29_ 2023-02-13 04:55:38,618 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/73b74c0e2ff54e839a4b4c408f7bdb7d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/73b74c0e2ff54e839a4b4c408f7bdb7d 2023-02-13 04:55:38,618 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8a153f3e5fcb481ebd21e3ca355b7e30_SeqId_29_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/8a153f3e5fcb481ebd21e3ca355b7e30_SeqId_29_ 2023-02-13 04:55:38,619 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/82af7af57ad8406e85da2dd803d5b55f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/82af7af57ad8406e85da2dd803d5b55f 2023-02-13 04:55:38,619 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6bd7e96b2ec742048a2b78a87c1471ad of snapshot=snaptb-1676264121277 to region=8937f228f64ed9a20627ea05b6572001 table=testCompactionWithHFileLink 2023-02-13 04:55:38,619 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5a9923c5c0814149962a041496b7cc5a_SeqId_29_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5a9923c5c0814149962a041496b7cc5a_SeqId_29_ 2023-02-13 04:55:38,619 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f2763d4a860a422fbae6bddcda8ed99e of snapshot=snaptb-1676264121277 to region=8cb2fc4355445fe1dc5705702cd065d7 table=testCompactionWithHFileLink 2023-02-13 04:55:38,620 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/b98c901532f1497f911f60f934139b6f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/b98c901532f1497f911f60f934139b6f 2023-02-13 04:55:38,620 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 60547bad0bab4d8c862c6549201f3182 of snapshot=snaptb-1676264121277 to region=f959d9fe54998a7bac6e6957f0f0316c table=testCompactionWithHFileLink 2023-02-13 04:55:38,627 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0417ff3fc0214f6c8d3f415d27e82bc8 of snapshot=snaptb-1676264121277 to region=8937f228f64ed9a20627ea05b6572001 table=testCompactionWithHFileLink 2023-02-13 04:55:38,627 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d372afe1de784aec8b39d308768b70aa of snapshot=snaptb-1676264121277 to region=8cb2fc4355445fe1dc5705702cd065d7 table=testCompactionWithHFileLink 2023-02-13 04:55:38,627 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8e96a6378c1b444e90d537320ed1a301 of snapshot=snaptb-1676264121277 to region=f959d9fe54998a7bac6e6957f0f0316c table=testCompactionWithHFileLink 2023-02-13 04:55:38,637 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c98de4962b724fa6b1c5fe534e8d74b9 of snapshot=snaptb-1676264121277 to region=8937f228f64ed9a20627ea05b6572001 table=testCompactionWithHFileLink 2023-02-13 04:55:38,637 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a315feb18b2849578e7ffdc931ed46be of snapshot=snaptb-1676264121277 to region=8cb2fc4355445fe1dc5705702cd065d7 table=testCompactionWithHFileLink 2023-02-13 04:55:38,638 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9bf697f7cee647f297ab393619709ad9 of snapshot=snaptb-1676264121277 to region=f959d9fe54998a7bac6e6957f0f0316c table=testCompactionWithHFileLink 2023-02-13 04:55:38,644 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d05b8ad3e91b4da38d02507094745b02 of snapshot=snaptb-1676264121277 to region=8937f228f64ed9a20627ea05b6572001 table=testCompactionWithHFileLink 2023-02-13 04:55:38,644 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a62f3d4ab4f144ea90789a677febfe0d of snapshot=snaptb-1676264121277 to region=8cb2fc4355445fe1dc5705702cd065d7 table=testCompactionWithHFileLink 2023-02-13 04:55:38,644 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2b16bdf31e8c47d39baa16db6747d6bf of snapshot=snaptb-1676264121277 to region=f959d9fe54998a7bac6e6957f0f0316c table=testCompactionWithHFileLink 2023-02-13 04:55:38,650 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/4aab125d42f740c396470e2e160c0c28 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/4aab125d42f740c396470e2e160c0c28 2023-02-13 04:55:38,650 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 92bca81010524d70a4db84733e0dac74 of snapshot=snaptb-1676264121277 to region=f959d9fe54998a7bac6e6957f0f0316c table=testCompactionWithHFileLink 2023-02-13 04:55:38,651 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/6e1409980f8943c2b6dfe718fdeef078 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/6e1409980f8943c2b6dfe718fdeef078 2023-02-13 04:55:38,651 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c272a749b9b84b57af4555f49c0a879c of snapshot=snaptb-1676264121277 to region=8937f228f64ed9a20627ea05b6572001 table=testCompactionWithHFileLink 2023-02-13 04:55:38,654 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/8ea82962eee843ac996a7fc3b48d1540 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/8ea82962eee843ac996a7fc3b48d1540 2023-02-13 04:55:38,654 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bede7df0eb7a4fb19a6a3a86e279b7f8 of snapshot=snaptb-1676264121277 to region=8cb2fc4355445fe1dc5705702cd065d7 table=testCompactionWithHFileLink 2023-02-13 04:55:38,654 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 35be733fbe06433690e053a6be9048a0 of snapshot=snaptb-1676264121277 to region=f959d9fe54998a7bac6e6957f0f0316c table=testCompactionWithHFileLink 2023-02-13 04:55:38,658 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 947e710f0b6a4d8d8fee8c2a4464cd91 of snapshot=snaptb-1676264121277 to region=8937f228f64ed9a20627ea05b6572001 table=testCompactionWithHFileLink 2023-02-13 04:55:38,659 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 59b8e3a0514c42b4b36e2eb77f1f730d of snapshot=snaptb-1676264121277 to region=8cb2fc4355445fe1dc5705702cd065d7 table=testCompactionWithHFileLink 2023-02-13 04:55:38,660 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bb73c7733dcc46b0887a90cadfde5987 of snapshot=snaptb-1676264121277 to region=f959d9fe54998a7bac6e6957f0f0316c table=testCompactionWithHFileLink 2023-02-13 04:55:38,662 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1340fb92dd5a45de80302444387bc5d2 of snapshot=snaptb-1676264121277 to region=8937f228f64ed9a20627ea05b6572001 table=testCompactionWithHFileLink 2023-02-13 04:55:38,663 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d827348a583044009ebfadcec6ea38b9 of snapshot=snaptb-1676264121277 to region=8cb2fc4355445fe1dc5705702cd065d7 table=testCompactionWithHFileLink 2023-02-13 04:55:38,663 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c96bcf8057cb4dcf97abb5a33aa6c506 of snapshot=snaptb-1676264121277 to region=f959d9fe54998a7bac6e6957f0f0316c table=testCompactionWithHFileLink 2023-02-13 04:55:38,665 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2a44435d64fd4dd6a9a9c40202150f38 of snapshot=snaptb-1676264121277 to region=8937f228f64ed9a20627ea05b6572001 table=testCompactionWithHFileLink 2023-02-13 04:55:38,666 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e098b7eafd174a76a920cabd74b1518c of snapshot=snaptb-1676264121277 to region=8cb2fc4355445fe1dc5705702cd065d7 table=testCompactionWithHFileLink 2023-02-13 04:55:38,669 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676264121277" table: "testCompactionWithHFileLink" creation_time: 1676264121287 type: FLUSH version: 2 ttl: 0 2023-02-13 04:55:38,670 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676264138670"}]},"ts":"9223372036854775807"} 2023-02-13 04:55:38,670 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676264138670"}]},"ts":"9223372036854775807"} 2023-02-13 04:55:38,670 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676264138670"}]},"ts":"9223372036854775807"} 2023-02-13 04:55:38,672 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-13 04:55:38,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8937f228f64ed9a20627ea05b6572001, NAME => 'testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 8cb2fc4355445fe1dc5705702cd065d7, NAME => 'testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f959d9fe54998a7bac6e6957f0f0316c, NAME => 'testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.', STARTKEY => '', ENDKEY => '1'}] 2023-02-13 04:55:38,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264138671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264138671"}]},"ts":"1676264138671"} 2023-02-13 04:55:38,672 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264138671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264138671"}]},"ts":"1676264138671"} 2023-02-13 04:55:38,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264138671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264138671"}]},"ts":"1676264138671"} 2023-02-13 04:55:38,674 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 04:55:38,674 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-13 04:55:38,674 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 8937f228f64ed9a20627ea05b6572001, NAME => 'testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 8cb2fc4355445fe1dc5705702cd065d7, NAME => 'testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f959d9fe54998a7bac6e6957f0f0316c, NAME => 'testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.', STARTKEY => '', ENDKEY => '1'}] 2023-02-13 04:55:38,675 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676264121277 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-13 04:55:38,676 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676264121277" table: "testCompactionWithHFileLink" creation_time: 1676264121287 type: FLUSH version: 2 ttl: 0 ) in 532 msec 2023-02-13 04:55:38,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 04:55:38,757 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-13 04:55:38,757 INFO [Listener at localhost/37751] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676264121277-1676264135991 2023-02-13 04:55:38,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1676264121277-1676264135991" 2023-02-13 04:55:38,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676264121277-1676264135991 2023-02-13 04:55:38,766 INFO [Listener at localhost/37751] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-13 04:55:38,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$10(2372): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-02-13 04:55:38,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-13 04:55:38,777 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-13 04:55:38,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 04:55:38,777 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264138777"}]},"ts":"1676264138777"} 2023-02-13 04:55:38,778 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 04:55:38,781 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-13 04:55:38,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, ASSIGN}] 2023-02-13 04:55:38,782 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, ASSIGN 2023-02-13 04:55:38,782 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, ASSIGN 2023-02-13 04:55:38,782 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, ASSIGN 2023-02-13 04:55:38,783 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 04:55:38,783 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 04:55:38,783 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 04:55:38,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 04:55:38,934 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=8937f228f64ed9a20627ea05b6572001, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:38,934 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8cb2fc4355445fe1dc5705702cd065d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:38,934 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f959d9fe54998a7bac6e6957f0f0316c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:38,934 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264138934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264138934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264138934"}]},"ts":"1676264138934"} 2023-02-13 04:55:38,934 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264138934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264138934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264138934"}]},"ts":"1676264138934"} 2023-02-13 04:55:38,934 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264138934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264138934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264138934"}]},"ts":"1676264138934"} 2023-02-13 04:55:38,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 8937f228f64ed9a20627ea05b6572001, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:38,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 8cb2fc4355445fe1dc5705702cd065d7, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:38,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure f959d9fe54998a7bac6e6957f0f0316c, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:39,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 04:55:39,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:39,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f959d9fe54998a7bac6e6957f0f0316c, NAME => 'testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 04:55:39,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:39,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:39,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:39,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:39,091 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:39,092 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1 2023-02-13 04:55:39,092 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1 2023-02-13 04:55:39,092 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f959d9fe54998a7bac6e6957f0f0316c columnFamilyName family1 2023-02-13 04:55:39,107 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-2b16bdf31e8c47d39baa16db6747d6bf 2023-02-13 04:55:39,112 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-60547bad0bab4d8c862c6549201f3182 2023-02-13 04:55:39,117 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-8e96a6378c1b444e90d537320ed1a301 2023-02-13 04:55:39,122 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-9bf697f7cee647f297ab393619709ad9 2023-02-13 04:55:39,122 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(310): Store=f959d9fe54998a7bac6e6957f0f0316c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:39,123 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:39,123 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2 2023-02-13 04:55:39,123 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2 2023-02-13 04:55:39,124 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f959d9fe54998a7bac6e6957f0f0316c columnFamilyName family2 2023-02-13 04:55:39,130 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-35be733fbe06433690e053a6be9048a0 2023-02-13 04:55:39,135 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-92bca81010524d70a4db84733e0dac74 2023-02-13 04:55:39,141 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-bb73c7733dcc46b0887a90cadfde5987 2023-02-13 04:55:39,146 DEBUG [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-c96bcf8057cb4dcf97abb5a33aa6c506 2023-02-13 04:55:39,146 INFO [StoreOpener-f959d9fe54998a7bac6e6957f0f0316c-1] regionserver.HStore(310): Store=f959d9fe54998a7bac6e6957f0f0316c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:39,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:39,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:39,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:55:39,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:55:39,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f959d9fe54998a7bac6e6957f0f0316c; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74660640, jitterRate=0.11253023147583008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:55:39,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f959d9fe54998a7bac6e6957f0f0316c: Running coprocessor pre-open hook at 1676264139090Writing region info on filesystem at 1676264139090Initializing all the Stores at 1676264139091 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264139091Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264139091Cleaning up temporary data from old regions at 1676264139148 (+57 ms)Cleaning up detritus from prior splits at 1676264139149 (+1 ms)Running coprocessor post-open hooks at 1676264139151 (+2 ms)Region opened successfully at 1676264139151 2023-02-13 04:55:39,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c., pid=103, masterSystemTime=1676264139087 2023-02-13 04:55:39,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:55:39,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 04:55:39,152 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 04:55:39,152 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 04:55:39,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:39,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:39,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:39,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8cb2fc4355445fe1dc5705702cd065d7, NAME => 'testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 04:55:39,154 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f959d9fe54998a7bac6e6957f0f0316c, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:39,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:39,154 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264139154"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264139154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264139154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264139154"}]},"ts":"1676264139154"} 2023-02-13 04:55:39,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:39,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:39,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:39,155 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 04:55:39,155 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 04:55:39,155 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1912): f959d9fe54998a7bac6e6957f0f0316c/family1 is initiating minor compaction (all files) 2023-02-13 04:55:39,155 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HStore(1912): f959d9fe54998a7bac6e6957f0f0316c/family2 is initiating minor compaction (all files) 2023-02-13 04:55:39,155 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HRegion(2258): Starting compaction of f959d9fe54998a7bac6e6957f0f0316c/family2 in testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:39,155 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of f959d9fe54998a7bac6e6957f0f0316c/family1 in testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:55:39,155 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-92bca81010524d70a4db84733e0dac74, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-35be733fbe06433690e053a6be9048a0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-bb73c7733dcc46b0887a90cadfde5987, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-c96bcf8057cb4dcf97abb5a33aa6c506] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp, totalSize=20.4 K 2023-02-13 04:55:39,155 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-60547bad0bab4d8c862c6549201f3182, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-8e96a6378c1b444e90d537320ed1a301, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-9bf697f7cee647f297ab393619709ad9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-2b16bdf31e8c47d39baa16db6747d6bf] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp, totalSize=21.6 K 2023-02-13 04:55:39,155 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:39,156 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-92bca81010524d70a4db84733e0dac74, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114135 2023-02-13 04:55:39,156 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-60547bad0bab4d8c862c6549201f3182, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114135 2023-02-13 04:55:39,156 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-35be733fbe06433690e053a6be9048a0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:39,156 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1 2023-02-13 04:55:39,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-13 04:55:39,157 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1 2023-02-13 04:55:39,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure f959d9fe54998a7bac6e6957f0f0316c, server=jenkins-hbase4.apache.org,37513,1676264019660 in 218 msec 2023-02-13 04:55:39,157 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb2fc4355445fe1dc5705702cd065d7 columnFamilyName family1 2023-02-13 04:55:39,157 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-8e96a6378c1b444e90d537320ed1a301, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:39,157 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-bb73c7733dcc46b0887a90cadfde5987, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:39,158 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f959d9fe54998a7bac6e6957f0f0316c, ASSIGN in 376 msec 2023-02-13 04:55:39,158 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-9bf697f7cee647f297ab393619709ad9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:39,158 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-c96bcf8057cb4dcf97abb5a33aa6c506, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:39,159 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-2b16bdf31e8c47d39baa16db6747d6bf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:39,171 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a315feb18b2849578e7ffdc931ed46be 2023-02-13 04:55:39,180 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a62f3d4ab4f144ea90789a677febfe0d 2023-02-13 04:55:39,192 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d372afe1de784aec8b39d308768b70aa 2023-02-13 04:55:39,199 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): f959d9fe54998a7bac6e6957f0f0316c#family1#compaction#113 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:55:39,206 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] throttle.PressureAwareThroughputController(145): f959d9fe54998a7bac6e6957f0f0316c#family2#compaction#114 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:55:39,207 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-f2763d4a860a422fbae6bddcda8ed99e 2023-02-13 04:55:39,208 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(310): Store=8cb2fc4355445fe1dc5705702cd065d7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:39,208 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:39,209 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2 2023-02-13 04:55:39,209 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2 2023-02-13 04:55:39,209 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb2fc4355445fe1dc5705702cd065d7 columnFamilyName family2 2023-02-13 04:55:39,216 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-59b8e3a0514c42b4b36e2eb77f1f730d 2023-02-13 04:55:39,220 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-bede7df0eb7a4fb19a6a3a86e279b7f8 2023-02-13 04:55:39,224 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d827348a583044009ebfadcec6ea38b9 2023-02-13 04:55:39,228 DEBUG [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-e098b7eafd174a76a920cabd74b1518c 2023-02-13 04:55:39,228 INFO [StoreOpener-8cb2fc4355445fe1dc5705702cd065d7-1] regionserver.HStore(310): Store=8cb2fc4355445fe1dc5705702cd065d7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:39,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:39,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:39,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:55:39,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:55:39,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8cb2fc4355445fe1dc5705702cd065d7; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67327164, jitterRate=0.0032529234886169434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:55:39,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8cb2fc4355445fe1dc5705702cd065d7: Running coprocessor pre-open hook at 1676264139154Writing region info on filesystem at 1676264139154Initializing all the Stores at 1676264139155 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264139155Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264139155Cleaning up temporary data from old regions at 1676264139230 (+75 ms)Cleaning up detritus from prior splits at 1676264139230Running coprocessor post-open hooks at 1676264139232 (+2 ms)Region opened successfully at 1676264139232 2023-02-13 04:55:39,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7., pid=102, masterSystemTime=1676264139087 2023-02-13 04:55:39,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 04:55:39,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-13 04:55:39,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:39,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:39,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:39,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8937f228f64ed9a20627ea05b6572001, NAME => 'testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 04:55:39,234 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8cb2fc4355445fe1dc5705702cd065d7, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:39,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:39,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:39,234 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676264139234"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264139234"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264139234"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264139234"}]},"ts":"1676264139234"} 2023-02-13 04:55:39,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:39,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:39,235 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:39,236 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1 2023-02-13 04:55:39,236 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1 2023-02-13 04:55:39,237 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8937f228f64ed9a20627ea05b6572001 columnFamilyName family1 2023-02-13 04:55:39,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-02-13 04:55:39,238 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 8cb2fc4355445fe1dc5705702cd065d7, server=jenkins-hbase4.apache.org,37513,1676264019660 in 300 msec 2023-02-13 04:55:39,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8cb2fc4355445fe1dc5705702cd065d7, ASSIGN in 457 msec 2023-02-13 04:55:39,242 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-0417ff3fc0214f6c8d3f415d27e82bc8 2023-02-13 04:55:39,246 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-6bd7e96b2ec742048a2b78a87c1471ad 2023-02-13 04:55:39,251 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c98de4962b724fa6b1c5fe534e8d74b9 2023-02-13 04:55:39,256 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-d05b8ad3e91b4da38d02507094745b02 2023-02-13 04:55:39,256 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(310): Store=8937f228f64ed9a20627ea05b6572001/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:39,257 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:39,257 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2 2023-02-13 04:55:39,257 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2 2023-02-13 04:55:39,258 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8937f228f64ed9a20627ea05b6572001 columnFamilyName family2 2023-02-13 04:55:39,264 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-1340fb92dd5a45de80302444387bc5d2 2023-02-13 04:55:39,269 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-2a44435d64fd4dd6a9a9c40202150f38 2023-02-13 04:55:39,274 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-947e710f0b6a4d8d8fee8c2a4464cd91 2023-02-13 04:55:39,279 DEBUG [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(539): loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c272a749b9b84b57af4555f49c0a879c 2023-02-13 04:55:39,279 INFO [StoreOpener-8937f228f64ed9a20627ea05b6572001-1] regionserver.HStore(310): Store=8937f228f64ed9a20627ea05b6572001/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:39,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:39,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:39,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:55:39,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:55:39,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8937f228f64ed9a20627ea05b6572001; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72533859, jitterRate=0.08083872497081757}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:55:39,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8937f228f64ed9a20627ea05b6572001: Running coprocessor pre-open hook at 1676264139235Writing region info on filesystem at 1676264139235Initializing all the Stores at 1676264139235Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264139235Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264139235Cleaning up temporary data from old regions at 1676264139281 (+46 ms)Cleaning up detritus from prior splits at 1676264139281Running coprocessor post-open hooks at 1676264139283 (+2 ms)Region opened successfully at 1676264139283 2023-02-13 04:55:39,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001., pid=101, masterSystemTime=1676264139087 2023-02-13 04:55:39,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 04:55:39,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 04:55:39,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:39,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:39,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=8937f228f64ed9a20627ea05b6572001, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:39,286 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264139285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264139285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264139285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264139285"}]},"ts":"1676264139285"} 2023-02-13 04:55:39,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-13 04:55:39,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 8937f228f64ed9a20627ea05b6572001, server=jenkins-hbase4.apache.org,37513,1676264019660 in 351 msec 2023-02-13 04:55:39,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-02-13 04:55:39,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8937f228f64ed9a20627ea05b6572001, ASSIGN in 507 msec 2023-02-13 04:55:39,289 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264139289"}]},"ts":"1676264139289"} 2023-02-13 04:55:39,290 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 04:55:39,292 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-13 04:55:39,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 521 msec 2023-02-13 04:55:39,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 04:55:39,380 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-13 04:55:39,391 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:39,398 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:39,405 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:39,406 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:39,412 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 04:55:39,425 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 04:55:39,425 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:39,426 DEBUG [Listener at localhost/37751] zookeeper.ReadOnlyZKClient(139): Connect 0x4a4a2dbf to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:55:39,430 DEBUG [Listener at localhost/37751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4537b106, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:55:39,431 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:39,431 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:39,431 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:39,906 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021330ec2dec30d342ef983a7facd02e9189 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021330ec2dec30d342ef983a7facd02e9189 2023-02-13 04:55:39,906 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:39,919 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:55:39,921 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41306, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:55:39,927 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:55:39,929 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56274, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:55:39,937 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/5fcd1cbb04f04a9fa09e795ce65d7ba0 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-13 04:55:39,937 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/5fcd1cbb04f04a9fa09e795ce65d7ba0}] 2023-02-13 04:55:39,941 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/5fcd1cbb04f04a9fa09e795ce65d7ba0 for inclusion in 8cb2fc4355445fe1dc5705702cd065d7/family1 2023-02-13 04:55:39,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-13 04:55:39,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 04:55:39,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:39,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/5fcd1cbb04f04a9fa09e795ce65d7ba0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__psgei43tnmhv58slc7f2o86soqrtsf7qc9vut3aa02m3ttcnjscqbn1ig4bfaiu3/family1/5fcd1cbb04f04a9fa09e795ce65d7ba0 2023-02-13 04:55:39,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__psgei43tnmhv58slc7f2o86soqrtsf7qc9vut3aa02m3ttcnjscqbn1ig4bfaiu3/family1/5fcd1cbb04f04a9fa09e795ce65d7ba0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5416e067563849b28f49afca6fceb404_SeqId_34_ 2023-02-13 04:55:39,946 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__psgei43tnmhv58slc7f2o86soqrtsf7qc9vut3aa02m3ttcnjscqbn1ig4bfaiu3/family1/5fcd1cbb04f04a9fa09e795ce65d7ba0 into 8cb2fc4355445fe1dc5705702cd065d7/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5416e067563849b28f49afca6fceb404_SeqId_34_ - updating store file list. 2023-02-13 04:55:39,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5416e067563849b28f49afca6fceb404_SeqId_34_ into 8cb2fc4355445fe1dc5705702cd065d7/family1 2023-02-13 04:55:39,949 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__psgei43tnmhv58slc7f2o86soqrtsf7qc9vut3aa02m3ttcnjscqbn1ig4bfaiu3/family1/5fcd1cbb04f04a9fa09e795ce65d7ba0 into 8cb2fc4355445fe1dc5705702cd065d7/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5416e067563849b28f49afca6fceb404_SeqId_34_) 2023-02-13 04:55:39,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__psgei43tnmhv58slc7f2o86soqrtsf7qc9vut3aa02m3ttcnjscqbn1ig4bfaiu3/family1/5fcd1cbb04f04a9fa09e795ce65d7ba0 2023-02-13 04:55:39,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:39,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-13 04:55:39,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): 8cb2fc4355445fe1dc5705702cd065d7/family1 is initiating minor compaction (all files) 2023-02-13 04:55:39,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@69071a89; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 04:55:39,952 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:39,953 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:39,954 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302130f9b57e163594b44a699ebe9a13a66e4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302130f9b57e163594b44a699ebe9a13a66e4 2023-02-13 04:55:39,955 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302133772d2d49d094ab5859cff891286e3bd to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302133772d2d49d094ab5859cff891286e3bd 2023-02-13 04:55:39,956 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023021348b3c1f2652541588c20bea476922c01 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023021348b3c1f2652541588c20bea476922c01 2023-02-13 04:55:39,957 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302138aa17bb4423d499c89e7f8a557cfd9c9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302138aa17bb4423d499c89e7f8a557cfd9c9 2023-02-13 04:55:39,957 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 04:55:39,957 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 04:55:39,957 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:40,020 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family1/0f1ca19c2b4e4f088d23b813034c656b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/0f1ca19c2b4e4f088d23b813034c656b 2023-02-13 04:55:40,024 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f959d9fe54998a7bac6e6957f0f0316c/family1 of f959d9fe54998a7bac6e6957f0f0316c into 0f1ca19c2b4e4f088d23b813034c656b(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:55:40,024 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:40,025 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c., storeName=f959d9fe54998a7bac6e6957f0f0316c/family1, priority=12, startTime=1676264139152; duration=0sec 2023-02-13 04:55:40,025 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 04:55:40,025 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8cb2fc4355445fe1dc5705702cd065d7/family1 in testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:40,025 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-f2763d4a860a422fbae6bddcda8ed99e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d372afe1de784aec8b39d308768b70aa, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a315feb18b2849578e7ffdc931ed46be, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a62f3d4ab4f144ea90789a677febfe0d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5416e067563849b28f49afca6fceb404_SeqId_34_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp, totalSize=28.9 K 2023-02-13 04:55:40,025 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-f2763d4a860a422fbae6bddcda8ed99e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114137 2023-02-13 04:55:40,026 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d372afe1de784aec8b39d308768b70aa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:40,026 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a315feb18b2849578e7ffdc931ed46be, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:40,027 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a62f3d4ab4f144ea90789a677febfe0d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:40,027 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 5416e067563849b28f49afca6fceb404_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676264114137 2023-02-13 04:55:40,040 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8cb2fc4355445fe1dc5705702cd065d7#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:55:40,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-60547bad0bab4d8c862c6549201f3182, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-8e96a6378c1b444e90d537320ed1a301, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-9bf697f7cee647f297ab393619709ad9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-2b16bdf31e8c47d39baa16db6747d6bf] to archive 2023-02-13 04:55:40,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:40,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-60547bad0bab4d8c862c6549201f3182 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-60547bad0bab4d8c862c6549201f3182 2023-02-13 04:55:40,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-8e96a6378c1b444e90d537320ed1a301 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-8e96a6378c1b444e90d537320ed1a301 2023-02-13 04:55:40,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-9bf697f7cee647f297ab393619709ad9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-9bf697f7cee647f297ab393619709ad9 2023-02-13 04:55:40,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-2b16bdf31e8c47d39baa16db6747d6bf to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-2b16bdf31e8c47d39baa16db6747d6bf 2023-02-13 04:55:40,306 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213c3f31ac413e74fe28d9af28a9f603863 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c3f31ac413e74fe28d9af28a9f603863 2023-02-13 04:55:40,307 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213b2b1395c118a4231beaab07af24cf348 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b2b1395c118a4231beaab07af24cf348 2023-02-13 04:55:40,307 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:40,308 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:40,333 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/02a86d14000548e7b1ba22a4ff9022d5 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-13 04:55:40,334 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/9afc3f41e9424bbaac16a924cc338a56 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-13 04:55:40,334 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=32 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/02a86d14000548e7b1ba22a4ff9022d5}] 2023-02-13 04:55:40,334 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/9afc3f41e9424bbaac16a924cc338a56}] 2023-02-13 04:55:40,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/02a86d14000548e7b1ba22a4ff9022d5 for inclusion in f959d9fe54998a7bac6e6957f0f0316c/family1 2023-02-13 04:55:40,337 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/9afc3f41e9424bbaac16a924cc338a56 for inclusion in 8937f228f64ed9a20627ea05b6572001/family1 2023-02-13 04:55:40,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-13 04:55:40,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 04:55:40,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:40,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-13 04:55:40,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 04:55:40,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:40,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/02a86d14000548e7b1ba22a4ff9022d5 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__fnjvnp6kf3mup68kklvm8a8hfii8d8pun3oaucuksa5bj8va7rkfk7hvktanp60u/family1/02a86d14000548e7b1ba22a4ff9022d5 2023-02-13 04:55:40,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/9afc3f41e9424bbaac16a924cc338a56 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__s81dpf8n4gu195vt45mhf4b4mpvjv27akfql93enk47d7ms6c2eaj47qp4peiros/family1/9afc3f41e9424bbaac16a924cc338a56 2023-02-13 04:55:40,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__fnjvnp6kf3mup68kklvm8a8hfii8d8pun3oaucuksa5bj8va7rkfk7hvktanp60u/family1/02a86d14000548e7b1ba22a4ff9022d5 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/a9e8b4242bfa43f2ba012a7a7f6002da_SeqId_35_ 2023-02-13 04:55:40,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__s81dpf8n4gu195vt45mhf4b4mpvjv27akfql93enk47d7ms6c2eaj47qp4peiros/family1/9afc3f41e9424bbaac16a924cc338a56 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/3e1db7d3002a42189271c569caa23e53_SeqId_34_ 2023-02-13 04:55:40,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__fnjvnp6kf3mup68kklvm8a8hfii8d8pun3oaucuksa5bj8va7rkfk7hvktanp60u/family1/02a86d14000548e7b1ba22a4ff9022d5 into f959d9fe54998a7bac6e6957f0f0316c/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/a9e8b4242bfa43f2ba012a7a7f6002da_SeqId_35_ - updating store file list. 2023-02-13 04:55:40,343 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__s81dpf8n4gu195vt45mhf4b4mpvjv27akfql93enk47d7ms6c2eaj47qp4peiros/family1/9afc3f41e9424bbaac16a924cc338a56 into 8937f228f64ed9a20627ea05b6572001/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/3e1db7d3002a42189271c569caa23e53_SeqId_34_ - updating store file list. 2023-02-13 04:55:40,346 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/3e1db7d3002a42189271c569caa23e53_SeqId_34_ into 8937f228f64ed9a20627ea05b6572001/family1 2023-02-13 04:55:40,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/a9e8b4242bfa43f2ba012a7a7f6002da_SeqId_35_ into f959d9fe54998a7bac6e6957f0f0316c/family1 2023-02-13 04:55:40,347 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__s81dpf8n4gu195vt45mhf4b4mpvjv27akfql93enk47d7ms6c2eaj47qp4peiros/family1/9afc3f41e9424bbaac16a924cc338a56 into 8937f228f64ed9a20627ea05b6572001/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/3e1db7d3002a42189271c569caa23e53_SeqId_34_) 2023-02-13 04:55:40,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__fnjvnp6kf3mup68kklvm8a8hfii8d8pun3oaucuksa5bj8va7rkfk7hvktanp60u/family1/02a86d14000548e7b1ba22a4ff9022d5 into f959d9fe54998a7bac6e6957f0f0316c/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family1/a9e8b4242bfa43f2ba012a7a7f6002da_SeqId_35_) 2023-02-13 04:55:40,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__s81dpf8n4gu195vt45mhf4b4mpvjv27akfql93enk47d7ms6c2eaj47qp4peiros/family1/9afc3f41e9424bbaac16a924cc338a56 2023-02-13 04:55:40,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:40,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testCompactionWithHFileLink__fnjvnp6kf3mup68kklvm8a8hfii8d8pun3oaucuksa5bj8va7rkfk7hvktanp60u/family1/02a86d14000548e7b1ba22a4ff9022d5 2023-02-13 04:55:40,349 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:40,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-13 04:55:40,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): 8937f228f64ed9a20627ea05b6572001/family1 is initiating minor compaction (all files) 2023-02-13 04:55:40,350 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:40,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4bc1916; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 04:55:40,351 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302134cc030cdad9e4d628dc5f287960172bc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302134cc030cdad9e4d628dc5f287960172bc 2023-02-13 04:55:40,352 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:40,352 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:40,353 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213740cc6c27d6442e7af12f70600684ebe to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213740cc6c27d6442e7af12f70600684ebe 2023-02-13 04:55:40,354 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213319c7c45e3944d1f995e98ce5d1400b4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213319c7c45e3944d1f995e98ce5d1400b4 2023-02-13 04:55:40,354 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021379254681002e48f0be3ca5638e7b32fb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021379254681002e48f0be3ca5638e7b32fb 2023-02-13 04:55:40,355 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021347f6ad364105437790da65f217f632a8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021347f6ad364105437790da65f217f632a8 2023-02-13 04:55:40,355 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213a34d1e9cd76e46d88927a1609345925c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213a34d1e9cd76e46d88927a1609345925c 2023-02-13 04:55:40,355 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 04:55:40,355 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 04:55:40,355 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:40,356 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213fa2e16b102c04c29ab5b264265228241 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213fa2e16b102c04c29ab5b264265228241 2023-02-13 04:55:40,357 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213fb132639c629466691e84d7d939abd88 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213fb132639c629466691e84d7d939abd88 2023-02-13 04:55:40,357 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 04:55:40,357 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 04:55:40,357 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 04:55:40,357 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 04:55:40,361 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:40,363 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:40,366 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:40,367 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:40,372 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:40,373 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:40,389 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=286 (was 236) - Thread LEAK? -, OpenFileDescriptor=763 (was 597) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=165 (was 193), ProcessCount=168 (was 168), AvailableMemoryMB=3542 (was 3637) 2023-02-13 04:55:40,404 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=286, OpenFileDescriptor=763, MaxFileDescriptor=60000, SystemLoadAverage=165, ProcessCount=168, AvailableMemoryMB=3542 2023-02-13 04:55:40,410 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.HMaster$15(2997): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-02-13 04:55:40,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-13 04:55:40,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 04:55:40,417 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:55:40,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-02-13 04:55:40,423 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/.tmp/family2/32b19a6ffe9c4638ba38727a45076636 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/32b19a6ffe9c4638ba38727a45076636 2023-02-13 04:55:40,427 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f959d9fe54998a7bac6e6957f0f0316c/family2 of f959d9fe54998a7bac6e6957f0f0316c into 32b19a6ffe9c4638ba38727a45076636(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:40,427 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for f959d9fe54998a7bac6e6957f0f0316c: 2023-02-13 04:55:40,427 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c., storeName=f959d9fe54998a7bac6e6957f0f0316c/family2, priority=12, startTime=1676264139152; duration=1sec 2023-02-13 04:55:40,428 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 04:55:40,428 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 8937f228f64ed9a20627ea05b6572001/family1 in testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:40,428 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-6bd7e96b2ec742048a2b78a87c1471ad, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-0417ff3fc0214f6c8d3f415d27e82bc8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c98de4962b724fa6b1c5fe534e8d74b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-d05b8ad3e91b4da38d02507094745b02, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/3e1db7d3002a42189271c569caa23e53_SeqId_34_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp, totalSize=28.9 K 2023-02-13 04:55:40,428 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-6bd7e96b2ec742048a2b78a87c1471ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114136 2023-02-13 04:55:40,429 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-0417ff3fc0214f6c8d3f415d27e82bc8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:40,429 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c98de4962b724fa6b1c5fe534e8d74b9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:40,430 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-d05b8ad3e91b4da38d02507094745b02, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:40,430 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting 3e1db7d3002a42189271c569caa23e53_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676264114136 2023-02-13 04:55:40,445 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] throttle.PressureAwareThroughputController(145): 8937f228f64ed9a20627ea05b6572001#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:55:40,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-92bca81010524d70a4db84733e0dac74, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-35be733fbe06433690e053a6be9048a0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-bb73c7733dcc46b0887a90cadfde5987, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-c96bcf8057cb4dcf97abb5a33aa6c506] to archive 2023-02-13 04:55:40,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:40,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-92bca81010524d70a4db84733e0dac74 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-92bca81010524d70a4db84733e0dac74 2023-02-13 04:55:40,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-35be733fbe06433690e053a6be9048a0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-35be733fbe06433690e053a6be9048a0 2023-02-13 04:55:40,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-bb73c7733dcc46b0887a90cadfde5987 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-bb73c7733dcc46b0887a90cadfde5987 2023-02-13 04:55:40,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-c96bcf8057cb4dcf97abb5a33aa6c506 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/family2/testCompactionWithHFileLink=f959d9fe54998a7bac6e6957f0f0316c-c96bcf8057cb4dcf97abb5a33aa6c506 2023-02-13 04:55:40,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 04:55:40,517 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 04:55:40,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-13 04:55:40,519 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:55:40,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-13 04:55:40,520 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:55:40,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 04:55:40,522 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:40,522 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:40,522 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:40,522 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d empty. 2023-02-13 04:55:40,522 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57 empty. 2023-02-13 04:55:40,522 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940 empty. 2023-02-13 04:55:40,522 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:40,522 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:40,523 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:40,523 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-13 04:55:40,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 04:55:40,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 04:55:40,929 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 04:55:40,930 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 761c0e5bb8f03a25298dfc51c2ad6940, NAME => 'ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:55:40,931 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 48697bb307a98b9544461b85dd69ae57, NAME => 'ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:55:40,931 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7e59983b3de5930ab2ae0397fa6dba0d, NAME => 'ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:55:41,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 04:55:41,264 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family1/ea103f8c7df44e3e90862ac63e548ed8 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/ea103f8c7df44e3e90862ac63e548ed8 2023-02-13 04:55:41,267 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family1/b3a5dc5457284aadb6d489cf6c356f4a as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/b3a5dc5457284aadb6d489cf6c356f4a 2023-02-13 04:55:41,268 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 8cb2fc4355445fe1dc5705702cd065d7/family1 of 8cb2fc4355445fe1dc5705702cd065d7 into ea103f8c7df44e3e90862ac63e548ed8(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:41,268 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:41,269 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676264139951; duration=1sec 2023-02-13 04:55:41,269 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 04:55:41,269 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 04:55:41,271 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 8937f228f64ed9a20627ea05b6572001/family1 of 8937f228f64ed9a20627ea05b6572001 into b3a5dc5457284aadb6d489cf6c356f4a(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:55:41,271 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:41,271 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676264140350; duration=0sec 2023-02-13 04:55:41,271 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 04:55:41,271 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 04:55:41,272 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 04:55:41,272 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1912): 8937f228f64ed9a20627ea05b6572001/family2 is initiating minor compaction (all files) 2023-02-13 04:55:41,272 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8937f228f64ed9a20627ea05b6572001/family2 in testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:55:41,272 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c272a749b9b84b57af4555f49c0a879c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-947e710f0b6a4d8d8fee8c2a4464cd91, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-1340fb92dd5a45de80302444387bc5d2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-2a44435d64fd4dd6a9a9c40202150f38] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp, totalSize=20.4 K 2023-02-13 04:55:41,273 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c272a749b9b84b57af4555f49c0a879c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114136 2023-02-13 04:55:41,274 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-947e710f0b6a4d8d8fee8c2a4464cd91, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:41,274 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 04:55:41,274 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HStore(1912): 8cb2fc4355445fe1dc5705702cd065d7/family2 is initiating minor compaction (all files) 2023-02-13 04:55:41,274 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 8cb2fc4355445fe1dc5705702cd065d7/family2 in testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:55:41,274 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-bede7df0eb7a4fb19a6a3a86e279b7f8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-59b8e3a0514c42b4b36e2eb77f1f730d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d827348a583044009ebfadcec6ea38b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-e098b7eafd174a76a920cabd74b1518c] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp, totalSize=20.4 K 2023-02-13 04:55:41,275 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-1340fb92dd5a45de80302444387bc5d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:41,275 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-bede7df0eb7a4fb19a6a3a86e279b7f8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264114137 2023-02-13 04:55:41,275 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-2a44435d64fd4dd6a9a9c40202150f38, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:41,276 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-59b8e3a0514c42b4b36e2eb77f1f730d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264115919 2023-02-13 04:55:41,277 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d827348a583044009ebfadcec6ea38b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264117697 2023-02-13 04:55:41,277 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-e098b7eafd174a76a920cabd74b1518c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264119503 2023-02-13 04:55:41,288 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8937f228f64ed9a20627ea05b6572001#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:55:41,290 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] throttle.PressureAwareThroughputController(145): 8cb2fc4355445fe1dc5705702cd065d7#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:55:41,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-f2763d4a860a422fbae6bddcda8ed99e, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d372afe1de784aec8b39d308768b70aa, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a315feb18b2849578e7ffdc931ed46be, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a62f3d4ab4f144ea90789a677febfe0d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5416e067563849b28f49afca6fceb404_SeqId_34_] to archive 2023-02-13 04:55:41,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:41,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-f2763d4a860a422fbae6bddcda8ed99e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-f2763d4a860a422fbae6bddcda8ed99e 2023-02-13 04:55:41,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d372afe1de784aec8b39d308768b70aa to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d372afe1de784aec8b39d308768b70aa 2023-02-13 04:55:41,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a315feb18b2849578e7ffdc931ed46be to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a315feb18b2849578e7ffdc931ed46be 2023-02-13 04:55:41,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a62f3d4ab4f144ea90789a677febfe0d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-a62f3d4ab4f144ea90789a677febfe0d 2023-02-13 04:55:41,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5416e067563849b28f49afca6fceb404_SeqId_34_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family1/5416e067563849b28f49afca6fceb404_SeqId_34_ 2023-02-13 04:55:41,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-6bd7e96b2ec742048a2b78a87c1471ad, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-0417ff3fc0214f6c8d3f415d27e82bc8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c98de4962b724fa6b1c5fe534e8d74b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-d05b8ad3e91b4da38d02507094745b02, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/3e1db7d3002a42189271c569caa23e53_SeqId_34_] to archive 2023-02-13 04:55:41,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:41,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-6bd7e96b2ec742048a2b78a87c1471ad to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-6bd7e96b2ec742048a2b78a87c1471ad 2023-02-13 04:55:41,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-0417ff3fc0214f6c8d3f415d27e82bc8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-0417ff3fc0214f6c8d3f415d27e82bc8 2023-02-13 04:55:41,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c98de4962b724fa6b1c5fe534e8d74b9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c98de4962b724fa6b1c5fe534e8d74b9 2023-02-13 04:55:41,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-d05b8ad3e91b4da38d02507094745b02 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-d05b8ad3e91b4da38d02507094745b02 2023-02-13 04:55:41,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/3e1db7d3002a42189271c569caa23e53_SeqId_34_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family1/3e1db7d3002a42189271c569caa23e53_SeqId_34_ 2023-02-13 04:55:41,336 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:41,336 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 761c0e5bb8f03a25298dfc51c2ad6940, disabling compactions & flushes 2023-02-13 04:55:41,336 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:41,336 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:41,336 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. after waiting 0 ms 2023-02-13 04:55:41,336 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:41,336 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:41,336 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 761c0e5bb8f03a25298dfc51c2ad6940: Waiting for close lock at 1676264141336Disabling compacts and flushes for region at 1676264141336Disabling writes for close at 1676264141336Writing region close event to WAL at 1676264141336Closed at 1676264141336 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 7e59983b3de5930ab2ae0397fa6dba0d, disabling compactions & flushes 2023-02-13 04:55:41,337 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. after waiting 0 ms 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:41,337 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 48697bb307a98b9544461b85dd69ae57, disabling compactions & flushes 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 7e59983b3de5930ab2ae0397fa6dba0d: Waiting for close lock at 1676264141337Disabling compacts and flushes for region at 1676264141337Disabling writes for close at 1676264141337Writing region close event to WAL at 1676264141337Closed at 1676264141337 2023-02-13 04:55:41,337 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. after waiting 0 ms 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:41,337 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:41,337 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 48697bb307a98b9544461b85dd69ae57: Waiting for close lock at 1676264141337Disabling compacts and flushes for region at 1676264141337Disabling writes for close at 1676264141337Writing region close event to WAL at 1676264141337Closed at 1676264141337 2023-02-13 04:55:41,339 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:55:41,340 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676264141340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264141340"}]},"ts":"1676264141340"} 2023-02-13 04:55:41,340 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676264141340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264141340"}]},"ts":"1676264141340"} 2023-02-13 04:55:41,340 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676264141340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264141340"}]},"ts":"1676264141340"} 2023-02-13 04:55:41,341 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 04:55:41,342 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:55:41,342 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264141342"}]},"ts":"1676264141342"} 2023-02-13 04:55:41,343 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-13 04:55:41,346 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7e59983b3de5930ab2ae0397fa6dba0d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=48697bb307a98b9544461b85dd69ae57, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=761c0e5bb8f03a25298dfc51c2ad6940, ASSIGN}] 2023-02-13 04:55:41,348 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7e59983b3de5930ab2ae0397fa6dba0d, ASSIGN 2023-02-13 04:55:41,348 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=48697bb307a98b9544461b85dd69ae57, ASSIGN 2023-02-13 04:55:41,348 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=761c0e5bb8f03a25298dfc51c2ad6940, ASSIGN 2023-02-13 04:55:41,348 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7e59983b3de5930ab2ae0397fa6dba0d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:55:41,348 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=48697bb307a98b9544461b85dd69ae57, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:55:41,348 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=761c0e5bb8f03a25298dfc51c2ad6940, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:55:41,377 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:55:41,417 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-02-13 04:55:41,501 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=761c0e5bb8f03a25298dfc51c2ad6940, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:41,501 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7e59983b3de5930ab2ae0397fa6dba0d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:41,501 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=48697bb307a98b9544461b85dd69ae57, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:41,501 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676264141501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264141501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264141501"}]},"ts":"1676264141501"} 2023-02-13 04:55:41,501 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676264141501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264141501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264141501"}]},"ts":"1676264141501"} 2023-02-13 04:55:41,501 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676264141501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264141501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264141501"}]},"ts":"1676264141501"} 2023-02-13 04:55:41,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 761c0e5bb8f03a25298dfc51c2ad6940, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:41,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 7e59983b3de5930ab2ae0397fa6dba0d, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:41,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 48697bb307a98b9544461b85dd69ae57, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:55:41,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 04:55:41,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:41,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 48697bb307a98b9544461b85dd69ae57, NAME => 'ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 04:55:41,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:41,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:41,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:41,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:41,658 INFO [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:41,659 DEBUG [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1 2023-02-13 04:55:41,659 DEBUG [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1 2023-02-13 04:55:41,659 INFO [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48697bb307a98b9544461b85dd69ae57 columnFamilyName family1 2023-02-13 04:55:41,660 INFO [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] regionserver.HStore(310): Store=48697bb307a98b9544461b85dd69ae57/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:41,660 INFO [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:41,661 DEBUG [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2 2023-02-13 04:55:41,661 DEBUG [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2 2023-02-13 04:55:41,662 INFO [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 48697bb307a98b9544461b85dd69ae57 columnFamilyName family2 2023-02-13 04:55:41,663 INFO [StoreOpener-48697bb307a98b9544461b85dd69ae57-1] regionserver.HStore(310): Store=48697bb307a98b9544461b85dd69ae57/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:41,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:41,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:41,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:55:41,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 48697bb307a98b9544461b85dd69ae57 2023-02-13 04:55:41,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:55:41,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 48697bb307a98b9544461b85dd69ae57; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65534482, jitterRate=-0.02346011996269226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:55:41,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 48697bb307a98b9544461b85dd69ae57: Running coprocessor pre-open hook at 1676264141657Writing region info on filesystem at 1676264141657Initializing all the Stores at 1676264141657Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264141657Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264141657Cleaning up temporary data from old regions at 1676264141664 (+7 ms)Cleaning up detritus from prior splits at 1676264141664Running coprocessor post-open hooks at 1676264141667 (+3 ms)Region opened successfully at 1676264141667 2023-02-13 04:55:41,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57., pid=111, masterSystemTime=1676264141654 2023-02-13 04:55:41,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:41,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:41,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:41,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 761c0e5bb8f03a25298dfc51c2ad6940, NAME => 'ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 04:55:41,669 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=48697bb307a98b9544461b85dd69ae57, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:41,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:41,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:41,669 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676264141669"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264141669"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264141669"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264141669"}]},"ts":"1676264141669"} 2023-02-13 04:55:41,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:41,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:41,671 INFO [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:41,672 DEBUG [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1 2023-02-13 04:55:41,672 DEBUG [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1 2023-02-13 04:55:41,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-13 04:55:41,672 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 48697bb307a98b9544461b85dd69ae57, server=jenkins-hbase4.apache.org,37513,1676264019660 in 167 msec 2023-02-13 04:55:41,672 INFO [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 761c0e5bb8f03a25298dfc51c2ad6940 columnFamilyName family1 2023-02-13 04:55:41,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=48697bb307a98b9544461b85dd69ae57, ASSIGN in 326 msec 2023-02-13 04:55:41,673 INFO [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] regionserver.HStore(310): Store=761c0e5bb8f03a25298dfc51c2ad6940/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:41,673 INFO [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:41,674 DEBUG [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2 2023-02-13 04:55:41,674 DEBUG [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2 2023-02-13 04:55:41,674 INFO [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 761c0e5bb8f03a25298dfc51c2ad6940 columnFamilyName family2 2023-02-13 04:55:41,675 INFO [StoreOpener-761c0e5bb8f03a25298dfc51c2ad6940-1] regionserver.HStore(310): Store=761c0e5bb8f03a25298dfc51c2ad6940/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:41,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:41,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:41,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:55:41,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:55:41,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:55:41,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 761c0e5bb8f03a25298dfc51c2ad6940; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69544259, jitterRate=0.03629021346569061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:55:41,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 761c0e5bb8f03a25298dfc51c2ad6940: Running coprocessor pre-open hook at 1676264141670Writing region info on filesystem at 1676264141670Initializing all the Stores at 1676264141670Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264141670Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264141670Cleaning up temporary data from old regions at 1676264141677 (+7 ms)Cleaning up detritus from prior splits at 1676264141677Running coprocessor post-open hooks at 1676264141680 (+3 ms)Region opened successfully at 1676264141680 2023-02-13 04:55:41,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940., pid=109, masterSystemTime=1676264141654 2023-02-13 04:55:41,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:41,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:41,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:41,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7e59983b3de5930ab2ae0397fa6dba0d, NAME => 'ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 04:55:41,682 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=761c0e5bb8f03a25298dfc51c2ad6940, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:41,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:41,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:41,682 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676264141682"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264141682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264141682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264141682"}]},"ts":"1676264141682"} 2023-02-13 04:55:41,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:41,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:41,683 INFO [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:41,684 DEBUG [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1 2023-02-13 04:55:41,684 DEBUG [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1 2023-02-13 04:55:41,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-02-13 04:55:41,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 761c0e5bb8f03a25298dfc51c2ad6940, server=jenkins-hbase4.apache.org,37513,1676264019660 in 181 msec 2023-02-13 04:55:41,685 INFO [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e59983b3de5930ab2ae0397fa6dba0d columnFamilyName family1 2023-02-13 04:55:41,685 INFO [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] regionserver.HStore(310): Store=7e59983b3de5930ab2ae0397fa6dba0d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:41,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=761c0e5bb8f03a25298dfc51c2ad6940, ASSIGN in 339 msec 2023-02-13 04:55:41,686 INFO [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:41,687 DEBUG [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2 2023-02-13 04:55:41,687 DEBUG [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2 2023-02-13 04:55:41,687 INFO [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e59983b3de5930ab2ae0397fa6dba0d columnFamilyName family2 2023-02-13 04:55:41,687 INFO [StoreOpener-7e59983b3de5930ab2ae0397fa6dba0d-1] regionserver.HStore(310): Store=7e59983b3de5930ab2ae0397fa6dba0d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:55:41,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:41,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:41,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:55:41,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:55:41,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:55:41,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7e59983b3de5930ab2ae0397fa6dba0d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65909313, jitterRate=-0.01787470281124115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:55:41,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7e59983b3de5930ab2ae0397fa6dba0d: Running coprocessor pre-open hook at 1676264141683Writing region info on filesystem at 1676264141683Initializing all the Stores at 1676264141683Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264141683Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264141683Cleaning up temporary data from old regions at 1676264141689 (+6 ms)Cleaning up detritus from prior splits at 1676264141689Running coprocessor post-open hooks at 1676264141693 (+4 ms)Region opened successfully at 1676264141693 2023-02-13 04:55:41,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d., pid=110, masterSystemTime=1676264141654 2023-02-13 04:55:41,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:41,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:41,695 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7e59983b3de5930ab2ae0397fa6dba0d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:41,695 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676264141695"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264141695"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264141695"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264141695"}]},"ts":"1676264141695"} 2023-02-13 04:55:41,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-13 04:55:41,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 7e59983b3de5930ab2ae0397fa6dba0d, server=jenkins-hbase4.apache.org,37513,1676264019660 in 193 msec 2023-02-13 04:55:41,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-02-13 04:55:41,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7e59983b3de5930ab2ae0397fa6dba0d, ASSIGN in 351 msec 2023-02-13 04:55:41,699 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:55:41,699 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264141699"}]},"ts":"1676264141699"} 2023-02-13 04:55:41,700 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-13 04:55:41,702 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:55:41,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1850 sec 2023-02-13 04:55:41,705 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/.tmp/family2/9ee4a4f942af4869bcddacdd4d878547 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/9ee4a4f942af4869bcddacdd4d878547 2023-02-13 04:55:41,708 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 8937f228f64ed9a20627ea05b6572001/family2 of 8937f228f64ed9a20627ea05b6572001 into 9ee4a4f942af4869bcddacdd4d878547(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:55:41,708 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8937f228f64ed9a20627ea05b6572001: 2023-02-13 04:55:41,708 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001., storeName=8937f228f64ed9a20627ea05b6572001/family2, priority=12, startTime=1676264139284; duration=0sec 2023-02-13 04:55:41,709 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-13 04:55:41,709 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-13 04:55:41,709 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 04:55:41,709 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 04:55:41,709 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. because compaction request was cancelled 2023-02-13 04:55:41,709 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-13 04:55:41,710 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 04:55:41,710 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 04:55:41,710 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. because compaction request was cancelled 2023-02-13 04:55:41,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c272a749b9b84b57af4555f49c0a879c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-947e710f0b6a4d8d8fee8c2a4464cd91, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-1340fb92dd5a45de80302444387bc5d2, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-2a44435d64fd4dd6a9a9c40202150f38] to archive 2023-02-13 04:55:41,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:41,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c272a749b9b84b57af4555f49c0a879c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-c272a749b9b84b57af4555f49c0a879c 2023-02-13 04:55:41,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-947e710f0b6a4d8d8fee8c2a4464cd91 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-947e710f0b6a4d8d8fee8c2a4464cd91 2023-02-13 04:55:41,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-1340fb92dd5a45de80302444387bc5d2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-1340fb92dd5a45de80302444387bc5d2 2023-02-13 04:55:41,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-2a44435d64fd4dd6a9a9c40202150f38 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/family2/testCompactionWithHFileLink=8937f228f64ed9a20627ea05b6572001-2a44435d64fd4dd6a9a9c40202150f38 2023-02-13 04:55:42,506 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/.tmp/family2/8b87c2322fe0408ab3093e339e9393fa as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/8b87c2322fe0408ab3093e339e9393fa 2023-02-13 04:55:42,510 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 8cb2fc4355445fe1dc5705702cd065d7/family2 of 8cb2fc4355445fe1dc5705702cd065d7 into 8b87c2322fe0408ab3093e339e9393fa(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:42,510 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8cb2fc4355445fe1dc5705702cd065d7: 2023-02-13 04:55:42,510 INFO [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7., storeName=8cb2fc4355445fe1dc5705702cd065d7/family2, priority=12, startTime=1676264139233; duration=1sec 2023-02-13 04:55:42,510 DEBUG [RS:0;jenkins-hbase4:37513-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:55:42,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-bede7df0eb7a4fb19a6a3a86e279b7f8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-59b8e3a0514c42b4b36e2eb77f1f730d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d827348a583044009ebfadcec6ea38b9, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-e098b7eafd174a76a920cabd74b1518c] to archive 2023-02-13 04:55:42,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:42,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-bede7df0eb7a4fb19a6a3a86e279b7f8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-bede7df0eb7a4fb19a6a3a86e279b7f8 2023-02-13 04:55:42,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-59b8e3a0514c42b4b36e2eb77f1f730d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-59b8e3a0514c42b4b36e2eb77f1f730d 2023-02-13 04:55:42,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d827348a583044009ebfadcec6ea38b9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-d827348a583044009ebfadcec6ea38b9 2023-02-13 04:55:42,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-e098b7eafd174a76a920cabd74b1518c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/family2/testCompactionWithHFileLink=8cb2fc4355445fe1dc5705702cd065d7-e098b7eafd174a76a920cabd74b1518c 2023-02-13 04:55:42,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 04:55:42,625 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-13 04:55:42,630 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:42,631 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:42,631 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:42,633 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:42,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 04:55:42,634 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 04:55:42,634 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:42,634 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 04:55:42,634 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 04:55:42,635 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:42,635 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:42,636 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:42,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:42,636 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:42,636 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:42,636 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:42,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:42,637 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 04:55:42,637 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 04:55:42,637 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 04:55:42,637 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:42,637 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 04:55:42,637 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:42,637 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. started... 2023-02-13 04:55:42,637 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:42,639 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:42,639 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7e59983b3de5930ab2ae0397fa6dba0d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 04:55:42,639 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. started... 2023-02-13 04:55:42,637 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:42,639 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:42,639 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 48697bb307a98b9544461b85dd69ae57 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 04:55:42,639 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. started... 2023-02-13 04:55:42,640 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 761c0e5bb8f03a25298dfc51c2ad6940 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 04:55:43,054 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302134ead6743525c4174a51e1025b66562b4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302134ead6743525c4174a51e1025b66562b4 2023-02-13 04:55:43,055 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302135cc8a15b0c784065993d1f89f988af3d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302135cc8a15b0c784065993d1f89f988af3d 2023-02-13 04:55:43,055 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021398da70878e40466fbd589ccb7c28bfb5 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021398da70878e40466fbd589ccb7c28bfb5 2023-02-13 04:55:43,459 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/4ccf4a11b14448ae914d5ee87092f834 2023-02-13 04:55:43,459 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/c667631556e44cfc8d48eab1bd4d6a25 2023-02-13 04:55:43,460 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/9efb0182ecf947e0954e076a05c70e66 2023-02-13 04:55:43,473 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213637853e7e97b430d9a2fefe2df15eb7f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213637853e7e97b430d9a2fefe2df15eb7f 2023-02-13 04:55:43,874 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302136aafb7965f254726ae230c91ee3252bd to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302136aafb7965f254726ae230c91ee3252bd 2023-02-13 04:55:43,874 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213aa9819061d574fcfaa3e9b2c4d58e9ac to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213aa9819061d574fcfaa3e9b2c4d58e9ac 2023-02-13 04:55:43,881 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/c869e3c0189f4f5d9db0806a71bcb904 2023-02-13 04:55:43,885 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/c667631556e44cfc8d48eab1bd4d6a25 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/c667631556e44cfc8d48eab1bd4d6a25 2023-02-13 04:55:43,888 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/c667631556e44cfc8d48eab1bd4d6a25, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 04:55:43,888 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/c869e3c0189f4f5d9db0806a71bcb904 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c869e3c0189f4f5d9db0806a71bcb904 2023-02-13 04:55:43,892 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c869e3c0189f4f5d9db0806a71bcb904, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 04:55:43,893 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 48697bb307a98b9544461b85dd69ae57 in 1254ms, sequenceid=5, compaction requested=false 2023-02-13 04:55:43,893 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-13 04:55:43,893 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 48697bb307a98b9544461b85dd69ae57: 2023-02-13 04:55:43,893 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:43,893 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:44,281 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/ddaee16ec8734007a3db002cc717de95 2023-02-13 04:55:44,281 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/1817ae7ae0f64f919a4ad0f9f01892d1 2023-02-13 04:55:44,285 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/4ccf4a11b14448ae914d5ee87092f834 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/4ccf4a11b14448ae914d5ee87092f834 2023-02-13 04:55:44,285 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/9efb0182ecf947e0954e076a05c70e66 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9efb0182ecf947e0954e076a05c70e66 2023-02-13 04:55:44,288 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/4ccf4a11b14448ae914d5ee87092f834, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 04:55:44,288 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9efb0182ecf947e0954e076a05c70e66, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 04:55:44,289 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/ddaee16ec8734007a3db002cc717de95 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/ddaee16ec8734007a3db002cc717de95 2023-02-13 04:55:44,289 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/1817ae7ae0f64f919a4ad0f9f01892d1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/1817ae7ae0f64f919a4ad0f9f01892d1 2023-02-13 04:55:44,292 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/ddaee16ec8734007a3db002cc717de95, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 04:55:44,292 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/1817ae7ae0f64f919a4ad0f9f01892d1, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 04:55:44,293 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 761c0e5bb8f03a25298dfc51c2ad6940 in 1654ms, sequenceid=5, compaction requested=false 2023-02-13 04:55:44,293 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 761c0e5bb8f03a25298dfc51c2ad6940: 2023-02-13 04:55:44,294 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:44,294 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7e59983b3de5930ab2ae0397fa6dba0d in 1655ms, sequenceid=5, compaction requested=false 2023-02-13 04:55:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:44,294 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7e59983b3de5930ab2ae0397fa6dba0d: 2023-02-13 04:55:44,294 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 04:55:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 04:55:44,295 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,295 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:44,296 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:44,296 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:44,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:44,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 04:55:44,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@798c9fa7[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:44,297 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 04:55:44,297 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:44,298 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:44,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:44,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:44,298 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 04:55:44,298 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 04:55:44,298 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:44,298 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,298 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:44,301 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 04:55:44,301 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:44,301 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,301 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 04:55:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:44,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:44,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 04:55:44,303 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 04:55:44,303 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:44,303 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:44,303 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 04:55:44,303 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:44,305 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:44,305 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:44,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:44,305 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:44,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:44,305 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,306 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,308 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,308 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:44,308 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:44,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:44,308 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 04:55:44,309 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:44,308 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:44,308 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:44,309 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,308 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:44,309 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:44,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:44,309 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:44,309 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:44,309 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:44,309 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:44,409 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:44,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:44,411 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:44,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:44,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:44,414 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:44,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 04:55:44,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 04:55:44,415 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 04:55:44,415 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:44,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 04:55:44,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 04:55:44,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:44,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:44,417 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,417 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:44,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:44,417 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:44,417 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:44,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:44,418 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 04:55:44,418 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 04:55:44,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 04:55:44,418 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 04:55:44,418 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:44,418 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 04:55:44,419 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:44,419 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:44,419 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:44,419 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:44,419 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. started... 2023-02-13 04:55:44,419 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. started... 2023-02-13 04:55:44,419 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. started... 2023-02-13 04:55:44,419 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:44,419 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 48697bb307a98b9544461b85dd69ae57 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 04:55:44,419 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7e59983b3de5930ab2ae0397fa6dba0d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 04:55:44,419 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 761c0e5bb8f03a25298dfc51c2ad6940 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 04:55:44,836 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213065e3d0036834c75bd936538c67d009e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213065e3d0036834c75bd936538c67d009e 2023-02-13 04:55:44,836 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021352ce24404a994340963b744331745ecc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021352ce24404a994340963b744331745ecc 2023-02-13 04:55:44,836 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302131cc952b23bca440e874a67f6e8d035c1 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302131cc952b23bca440e874a67f6e8d035c1 2023-02-13 04:55:45,241 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/8b9b2cb92fc44799a593cfdca15e0d83 2023-02-13 04:55:45,241 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/065b1c8085e24e81a05be3050faebb04 2023-02-13 04:55:45,242 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/9438d28a65154763a93ddc7c523a237b 2023-02-13 04:55:45,658 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021301209b4cb52e4217ad6c207158dd3265 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021301209b4cb52e4217ad6c207158dd3265 2023-02-13 04:55:45,658 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213fe865894bbdc4401812805307901d8bf to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213fe865894bbdc4401812805307901d8bf 2023-02-13 04:55:45,658 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021324ff5e0a3c274fd384fddafa3e9f50ad to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021324ff5e0a3c274fd384fddafa3e9f50ad 2023-02-13 04:55:46,063 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/975b4cd0f69d4ace813c2327b2bea12f 2023-02-13 04:55:46,065 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/9580765adfda477cb3ec7bd5b17253d0 2023-02-13 04:55:46,065 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/40dcb85b088149549c2f5d4e91c5412a 2023-02-13 04:55:46,067 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/065b1c8085e24e81a05be3050faebb04 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/065b1c8085e24e81a05be3050faebb04 2023-02-13 04:55:46,068 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/9438d28a65154763a93ddc7c523a237b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9438d28a65154763a93ddc7c523a237b 2023-02-13 04:55:46,069 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/8b9b2cb92fc44799a593cfdca15e0d83 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8b9b2cb92fc44799a593cfdca15e0d83 2023-02-13 04:55:46,071 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/065b1c8085e24e81a05be3050faebb04, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 04:55:46,071 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/975b4cd0f69d4ace813c2327b2bea12f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/975b4cd0f69d4ace813c2327b2bea12f 2023-02-13 04:55:46,071 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9438d28a65154763a93ddc7c523a237b, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 04:55:46,072 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/9580765adfda477cb3ec7bd5b17253d0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/9580765adfda477cb3ec7bd5b17253d0 2023-02-13 04:55:46,072 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8b9b2cb92fc44799a593cfdca15e0d83, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 04:55:46,073 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/40dcb85b088149549c2f5d4e91c5412a as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/40dcb85b088149549c2f5d4e91c5412a 2023-02-13 04:55:46,075 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/975b4cd0f69d4ace813c2327b2bea12f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 04:55:46,076 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/9580765adfda477cb3ec7bd5b17253d0, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 04:55:46,076 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 48697bb307a98b9544461b85dd69ae57 in 1657ms, sequenceid=9, compaction requested=false 2023-02-13 04:55:46,076 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7e59983b3de5930ab2ae0397fa6dba0d in 1657ms, sequenceid=9, compaction requested=false 2023-02-13 04:55:46,076 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 48697bb307a98b9544461b85dd69ae57: 2023-02-13 04:55:46,076 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7e59983b3de5930ab2ae0397fa6dba0d: 2023-02-13 04:55:46,076 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:46,076 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:46,076 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:46,076 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:46,077 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/40dcb85b088149549c2f5d4e91c5412a, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 04:55:46,077 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 761c0e5bb8f03a25298dfc51c2ad6940 in 1658ms, sequenceid=9, compaction requested=false 2023-02-13 04:55:46,077 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 761c0e5bb8f03a25298dfc51c2ad6940: 2023-02-13 04:55:46,077 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:46,077 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:46,077 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:46,077 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,078 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 04:55:46,078 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 04:55:46,080 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:46,080 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:46,081 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:46,081 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:46,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 04:55:46,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a679440[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:46,082 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 04:55:46,082 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:46,083 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:46,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 04:55:46,083 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,083 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 04:55:46,083 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:46,088 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,088 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 04:55:46,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,088 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:46,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:46,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:46,088 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 04:55:46,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:46,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:46,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:46,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:46,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:46,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:46,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 04:55:46,090 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 04:55:46,090 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:46,090 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:46,090 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 04:55:46,090 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:46,091 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:46,091 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:46,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:46,091 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:46,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:46,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:46,092 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:46,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:46,093 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:46,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:46,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,094 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:46,095 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 04:55:46,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 04:55:46,095 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:46,095 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:46,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:46,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:46,095 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:46,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:46,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:46,195 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:46,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:46,197 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:46,197 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:46,197 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:46,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:46,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 04:55:46,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 04:55:46,201 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 04:55:46,201 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:46,201 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 04:55:46,201 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 04:55:46,202 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:46,202 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:46,203 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,203 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:46,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:46,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:46,203 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:46,203 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:46,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:46,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:46,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:46,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:46,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 04:55:46,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 04:55:46,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 04:55:46,204 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 04:55:46,204 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:46,204 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 04:55:46,205 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:46,205 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:46,205 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. started... 2023-02-13 04:55:46,205 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:46,205 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:46,205 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. started... 2023-02-13 04:55:46,205 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:46,205 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7e59983b3de5930ab2ae0397fa6dba0d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 04:55:46,205 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 48697bb307a98b9544461b85dd69ae57 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 04:55:46,205 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. started... 2023-02-13 04:55:46,205 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 761c0e5bb8f03a25298dfc51c2ad6940 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 04:55:46,241 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213bb7c9a04051a440d8a9b12206e53733b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213bb7c9a04051a440d8a9b12206e53733b 2023-02-13 04:55:46,242 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021383c6deadbd124abf90473947cdcec405 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021383c6deadbd124abf90473947cdcec405 2023-02-13 04:55:46,242 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302134d5d2449900046c1b89b1b79c5438399 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302134d5d2449900046c1b89b1b79c5438399 2023-02-13 04:55:46,261 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/8e0377fa91c6439a8480803995835d58 2023-02-13 04:55:46,651 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/802f37edd1d4460d96b588e45521cad5 2023-02-13 04:55:46,653 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/a52cb9ac835a4b45af3adc9fca283dd7 2023-02-13 04:55:46,676 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302132703a151be2544ab9e5b465d1741d76e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302132703a151be2544ab9e5b465d1741d76e 2023-02-13 04:55:47,064 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021371fd4d05925b4364942a93640bfce131 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021371fd4d05925b4364942a93640bfce131 2023-02-13 04:55:47,065 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021386e8de6365584fbc90cb2da603a8dcd2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021386e8de6365584fbc90cb2da603a8dcd2 2023-02-13 04:55:47,080 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/33c6e449bf4747b8b129ca2605c95783 2023-02-13 04:55:47,083 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/8e0377fa91c6439a8480803995835d58 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8e0377fa91c6439a8480803995835d58 2023-02-13 04:55:47,086 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8e0377fa91c6439a8480803995835d58, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 04:55:47,087 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/33c6e449bf4747b8b129ca2605c95783 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/33c6e449bf4747b8b129ca2605c95783 2023-02-13 04:55:47,090 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/33c6e449bf4747b8b129ca2605c95783, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 04:55:47,091 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 761c0e5bb8f03a25298dfc51c2ad6940 in 886ms, sequenceid=13, compaction requested=true 2023-02-13 04:55:47,091 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 761c0e5bb8f03a25298dfc51c2ad6940: 2023-02-13 04:55:47,091 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:47,091 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:47,158 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:55:47,469 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/481631f051d14c1cbaba5b453f231b7b 2023-02-13 04:55:47,469 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/c3f4e81393fc421fa5c0f58276a110e0 2023-02-13 04:55:47,473 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/802f37edd1d4460d96b588e45521cad5 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/802f37edd1d4460d96b588e45521cad5 2023-02-13 04:55:47,473 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/a52cb9ac835a4b45af3adc9fca283dd7 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/a52cb9ac835a4b45af3adc9fca283dd7 2023-02-13 04:55:47,476 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/802f37edd1d4460d96b588e45521cad5, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 04:55:47,476 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/a52cb9ac835a4b45af3adc9fca283dd7, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 04:55:47,477 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/481631f051d14c1cbaba5b453f231b7b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/481631f051d14c1cbaba5b453f231b7b 2023-02-13 04:55:47,477 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/c3f4e81393fc421fa5c0f58276a110e0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c3f4e81393fc421fa5c0f58276a110e0 2023-02-13 04:55:47,480 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/481631f051d14c1cbaba5b453f231b7b, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 04:55:47,480 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c3f4e81393fc421fa5c0f58276a110e0, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 04:55:47,481 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7e59983b3de5930ab2ae0397fa6dba0d in 1276ms, sequenceid=13, compaction requested=true 2023-02-13 04:55:47,481 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 48697bb307a98b9544461b85dd69ae57 in 1276ms, sequenceid=13, compaction requested=true 2023-02-13 04:55:47,481 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7e59983b3de5930ab2ae0397fa6dba0d: 2023-02-13 04:55:47,481 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 48697bb307a98b9544461b85dd69ae57: 2023-02-13 04:55:47,481 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:47,481 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:47,481 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:47,481 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:47,481 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:47,481 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,481 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 04:55:47,481 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 04:55:47,483 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:47,483 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:47,484 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:47,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 04:55:47,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d600f8e[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:47,485 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 04:55:47,485 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:47,486 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:47,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 04:55:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 04:55:47,486 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,486 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:47,486 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:47,488 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 04:55:47,488 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:47,488 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,488 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 04:55:47,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:47,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:47,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:47,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 04:55:47,491 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 04:55:47,491 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:47,491 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:47,491 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 04:55:47,491 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:47,492 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:47,492 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:47,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:47,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:47,493 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:47,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:47,493 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:47,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:47,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:47,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:47,494 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:47,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:47,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:47,497 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:47,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:47,497 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 04:55:47,497 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:47,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:47,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:47,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,498 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:47,498 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:47,498 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:47,498 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:47,498 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:47,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:47,598 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:47,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:47,600 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:47,600 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:47,600 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:55:47,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:47,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 04:55:47,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 04:55:47,603 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 04:55:47,604 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:47,604 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 04:55:47,604 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 04:55:47,604 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:47,604 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:47,605 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,605 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:47,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:47,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:47,605 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:47,605 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:47,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:47,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:47,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:47,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:47,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 04:55:47,606 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 04:55:47,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 04:55:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 04:55:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:47,606 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 04:55:47,607 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:47,607 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:47,607 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. started... 2023-02-13 04:55:47,607 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. started... 2023-02-13 04:55:47,607 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:47,607 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 48697bb307a98b9544461b85dd69ae57 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 04:55:47,607 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. started... 2023-02-13 04:55:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:47,607 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7e59983b3de5930ab2ae0397fa6dba0d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 04:55:47,607 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 761c0e5bb8f03a25298dfc51c2ad6940 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 04:55:48,018 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213d6611008c2fc4276b4ff4e4ce9e6669b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213d6611008c2fc4276b4ff4e4ce9e6669b 2023-02-13 04:55:48,018 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302138b1e7200ab7a4fec9375d1a27d689077 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302138b1e7200ab7a4fec9375d1a27d689077 2023-02-13 04:55:48,018 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302138389898bf9c5415da4d7d2d6c3853d0c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302138389898bf9c5415da4d7d2d6c3853d0c 2023-02-13 04:55:48,423 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/ad637709344e441593a29c9fc4e82eaa 2023-02-13 04:55:48,423 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/9df1f2c3a1ac43749058ea7cf47a8a7c 2023-02-13 04:55:48,423 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/5727bc749434447fa077b5acbdd31b78 2023-02-13 04:55:48,449 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021309fbe4164e3245f9a35b2f28e86a4e55 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021309fbe4164e3245f9a35b2f28e86a4e55 2023-02-13 04:55:48,455 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213b82561e8d94b48de8190cf3ec71a4fe1 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213b82561e8d94b48de8190cf3ec71a4fe1 2023-02-13 04:55:48,465 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/3a792b30363e4adb8d6298c251b0d7f7 2023-02-13 04:55:48,469 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/5727bc749434447fa077b5acbdd31b78 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/5727bc749434447fa077b5acbdd31b78 2023-02-13 04:55:48,472 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/5727bc749434447fa077b5acbdd31b78, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 04:55:48,472 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/3a792b30363e4adb8d6298c251b0d7f7 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/3a792b30363e4adb8d6298c251b0d7f7 2023-02-13 04:55:48,475 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/3a792b30363e4adb8d6298c251b0d7f7, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 04:55:48,476 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 761c0e5bb8f03a25298dfc51c2ad6940 in 869ms, sequenceid=17, compaction requested=true 2023-02-13 04:55:48,476 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 761c0e5bb8f03a25298dfc51c2ad6940: 2023-02-13 04:55:48,476 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:48,476 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:48,860 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213bc74b74252e047f8b5c634ccb97d187f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213bc74b74252e047f8b5c634ccb97d187f 2023-02-13 04:55:48,865 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/fa756ad2f79b46a19eb90f43a129820f 2023-02-13 04:55:48,869 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/9df1f2c3a1ac43749058ea7cf47a8a7c as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/9df1f2c3a1ac43749058ea7cf47a8a7c 2023-02-13 04:55:48,872 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/9df1f2c3a1ac43749058ea7cf47a8a7c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 04:55:48,872 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/fa756ad2f79b46a19eb90f43a129820f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/fa756ad2f79b46a19eb90f43a129820f 2023-02-13 04:55:48,875 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/fa756ad2f79b46a19eb90f43a129820f, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 04:55:48,876 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 48697bb307a98b9544461b85dd69ae57 in 1269ms, sequenceid=17, compaction requested=true 2023-02-13 04:55:48,876 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 48697bb307a98b9544461b85dd69ae57: 2023-02-13 04:55:48,876 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:48,876 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:49,265 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/77ae963471ef4c05ab21be0def3fc5ae 2023-02-13 04:55:49,270 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/ad637709344e441593a29c9fc4e82eaa as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/ad637709344e441593a29c9fc4e82eaa 2023-02-13 04:55:49,273 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/ad637709344e441593a29c9fc4e82eaa, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 04:55:49,274 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/77ae963471ef4c05ab21be0def3fc5ae as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/77ae963471ef4c05ab21be0def3fc5ae 2023-02-13 04:55:49,277 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/77ae963471ef4c05ab21be0def3fc5ae, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 04:55:49,278 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7e59983b3de5930ab2ae0397fa6dba0d in 1671ms, sequenceid=17, compaction requested=true 2023-02-13 04:55:49,278 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7e59983b3de5930ab2ae0397fa6dba0d: 2023-02-13 04:55:49,278 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:49,278 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:49,278 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:49,278 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,278 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 04:55:49,278 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 04:55:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:49,280 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:49,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:49,281 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:49,281 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:49,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:49,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 04:55:49,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68375cd0[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:49,282 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 04:55:49,282 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:49,283 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:49,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 04:55:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 04:55:49,283 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,283 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:49,283 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:49,284 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,284 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 04:55:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:49,284 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:49,284 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 04:55:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:49,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 04:55:49,286 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 04:55:49,286 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:49,286 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:49,287 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 04:55:49,287 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:49,290 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:49,290 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:49,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:49,290 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:49,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:49,291 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:49,291 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:49,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:49,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 04:55:49,294 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:49,294 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:49,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:49,294 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:49,394 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:49,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:49,416 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:55:49,417 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a4a2dbf to 127.0.0.1:54862 2023-02-13 04:55:49,417 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:49,417 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:55:49,417 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x357debea to 127.0.0.1:54862 2023-02-13 04:55:49,417 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:55:49,418 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:49,427 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:49,435 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:49,435 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:49,459 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:55:49,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 04:55:49,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 04:55:49,460 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 04:55:49,460 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:49,460 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 04:55:49,460 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 04:55:49,461 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:49,461 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:49,463 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,463 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:49,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:49,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:49,463 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:49,463 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:55:49,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:49,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:49,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:55:49,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:49,464 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 04:55:49,464 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 04:55:49,464 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 04:55:49,464 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:55:49,464 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 04:55:49,465 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:49,465 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:55:49,465 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:55:49,465 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:49,465 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:49,465 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. started... 2023-02-13 04:55:49,465 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. started... 2023-02-13 04:55:49,465 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. started... 2023-02-13 04:55:49,465 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 48697bb307a98b9544461b85dd69ae57 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 04:55:49,465 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 761c0e5bb8f03a25298dfc51c2ad6940 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 04:55:49,465 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7e59983b3de5930ab2ae0397fa6dba0d 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 04:55:50,281 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/0cf6e1554201464890bcb201b38ca4a2 2023-02-13 04:55:50,282 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/2decdbcb5f4a4664846531095c0ba745 2023-02-13 04:55:50,282 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/1dec1e5570404f6f802de7760887fcd9 2023-02-13 04:55:50,285 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0cf6e1554201464890bcb201b38ca4a2 2023-02-13 04:55:50,285 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1dec1e5570404f6f802de7760887fcd9 2023-02-13 04:55:50,286 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2decdbcb5f4a4664846531095c0ba745 2023-02-13 04:55:50,700 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/8dae8c1a9f4a4a8697ea6f6e2ec91e67 2023-02-13 04:55:50,703 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8dae8c1a9f4a4a8697ea6f6e2ec91e67 2023-02-13 04:55:50,704 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/2decdbcb5f4a4664846531095c0ba745 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/2decdbcb5f4a4664846531095c0ba745 2023-02-13 04:55:50,707 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2decdbcb5f4a4664846531095c0ba745 2023-02-13 04:55:50,707 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/2decdbcb5f4a4664846531095c0ba745, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 04:55:50,707 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/8dae8c1a9f4a4a8697ea6f6e2ec91e67 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/8dae8c1a9f4a4a8697ea6f6e2ec91e67 2023-02-13 04:55:50,710 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8dae8c1a9f4a4a8697ea6f6e2ec91e67 2023-02-13 04:55:50,710 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/8dae8c1a9f4a4a8697ea6f6e2ec91e67, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 04:55:50,711 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7e59983b3de5930ab2ae0397fa6dba0d in 1246ms, sequenceid=23, compaction requested=true 2023-02-13 04:55:50,711 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7e59983b3de5930ab2ae0397fa6dba0d: 2023-02-13 04:55:50,711 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:50,711 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:55:51,097 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/6ed88c445fc6470290ecf9a2d669b588 2023-02-13 04:55:51,098 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/c43fd97dba3845ee924671a3f92dbe10 2023-02-13 04:55:51,101 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ed88c445fc6470290ecf9a2d669b588 2023-02-13 04:55:51,101 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c43fd97dba3845ee924671a3f92dbe10 2023-02-13 04:55:51,101 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/0cf6e1554201464890bcb201b38ca4a2 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/0cf6e1554201464890bcb201b38ca4a2 2023-02-13 04:55:51,102 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/1dec1e5570404f6f802de7760887fcd9 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/1dec1e5570404f6f802de7760887fcd9 2023-02-13 04:55:51,105 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0cf6e1554201464890bcb201b38ca4a2 2023-02-13 04:55:51,105 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/0cf6e1554201464890bcb201b38ca4a2, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 04:55:51,105 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1dec1e5570404f6f802de7760887fcd9 2023-02-13 04:55:51,105 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/1dec1e5570404f6f802de7760887fcd9, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 04:55:51,105 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/6ed88c445fc6470290ecf9a2d669b588 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/6ed88c445fc6470290ecf9a2d669b588 2023-02-13 04:55:51,106 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/c43fd97dba3845ee924671a3f92dbe10 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/c43fd97dba3845ee924671a3f92dbe10 2023-02-13 04:55:51,109 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ed88c445fc6470290ecf9a2d669b588 2023-02-13 04:55:51,109 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/6ed88c445fc6470290ecf9a2d669b588, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 04:55:51,110 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c43fd97dba3845ee924671a3f92dbe10 2023-02-13 04:55:51,110 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/c43fd97dba3845ee924671a3f92dbe10, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 04:55:51,110 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 48697bb307a98b9544461b85dd69ae57 in 1645ms, sequenceid=23, compaction requested=true 2023-02-13 04:55:51,110 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 48697bb307a98b9544461b85dd69ae57: 2023-02-13 04:55:51,110 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:51,110 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:55:51,110 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 761c0e5bb8f03a25298dfc51c2ad6940 in 1645ms, sequenceid=23, compaction requested=true 2023-02-13 04:55:51,111 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 761c0e5bb8f03a25298dfc51c2ad6940: 2023-02-13 04:55:51,111 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:51,111 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:55:51,111 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:55:51,111 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,111 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 04:55:51,111 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 04:55:51,112 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:51,112 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:51,113 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:51,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:51,113 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:55:51,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:51,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:51,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 04:55:51,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75db87d6[Count = 0] remaining members to acquire global barrier 2023-02-13 04:55:51,114 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 04:55:51,114 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:51,115 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:51,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:51,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:51,115 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 04:55:51,116 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 04:55:51,116 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:55:51,116 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,116 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:55:51,122 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,122 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 04:55:51,122 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:51,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,122 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 04:55:51,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:51,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:51,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:51,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:51,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:51,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:51,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:55:51,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 04:55:51,125 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 04:55:51,125 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:55:51,125 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:55:51,125 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 04:55:51,125 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:55:51,126 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:51,126 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:55:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:55:51,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:51,127 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:55:51,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:51,127 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:51,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:55:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:51,128 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:55:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 04:55:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,130 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:55:51,130 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:55:51,131 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:55:51,131 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:55:51,131 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 04:55:51,131 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:55:51,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:55:51,131 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:51,131 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 04:55:51,131 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:55:51,131 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:51,131 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 04:55:51,131 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 04:55:51,131 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 04:55:51,131 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:55:51,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:55:51,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:55:51,231 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:55:51,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:55:51,232 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:51,233 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 7e59983b3de5930ab2ae0397fa6dba0d/family1 is initiating major compaction (all files) 2023-02-13 04:55:51,233 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:51,233 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:51,234 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 7e59983b3de5930ab2ae0397fa6dba0d/family1 in ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:51,234 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9efb0182ecf947e0954e076a05c70e66, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9438d28a65154763a93ddc7c523a237b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/802f37edd1d4460d96b588e45521cad5, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/ad637709344e441593a29c9fc4e82eaa, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/2decdbcb5f4a4664846531095c0ba745] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp, totalSize=26.6 K 2023-02-13 04:55:51,235 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 9efb0182ecf947e0954e076a05c70e66, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264142630 2023-02-13 04:55:51,235 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 9438d28a65154763a93ddc7c523a237b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264144411 2023-02-13 04:55:51,236 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 802f37edd1d4460d96b588e45521cad5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264146197 2023-02-13 04:55:51,236 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting ad637709344e441593a29c9fc4e82eaa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264147600 2023-02-13 04:55:51,236 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 2decdbcb5f4a4664846531095c0ba745, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:55:51,245 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 7e59983b3de5930ab2ae0397fa6dba0d#family1#compaction#149 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:51,653 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213c308a0d3103b48ed8d2e587dd752881a_del 2023-02-13 04:55:51,653 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213c308a0d3103b48ed8d2e587dd752881a_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213c308a0d3103b48ed8d2e587dd752881a_del 2023-02-13 04:55:52,466 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4674f54b432b4ee895cf9a1554c4be43 2023-02-13 04:55:52,466 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family1/4674f54b432b4ee895cf9a1554c4be43 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/4674f54b432b4ee895cf9a1554c4be43 2023-02-13 04:55:52,469 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4674f54b432b4ee895cf9a1554c4be43 2023-02-13 04:55:52,470 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7e59983b3de5930ab2ae0397fa6dba0d/family1 of 7e59983b3de5930ab2ae0397fa6dba0d into 4674f54b432b4ee895cf9a1554c4be43(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:52,470 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 7e59983b3de5930ab2ae0397fa6dba0d: 2023-02-13 04:55:52,470 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:52,471 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 7e59983b3de5930ab2ae0397fa6dba0d/family2 is initiating major compaction (all files) 2023-02-13 04:55:52,471 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:52,471 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:52,471 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 7e59983b3de5930ab2ae0397fa6dba0d/family2 in ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:55:52,472 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/1817ae7ae0f64f919a4ad0f9f01892d1, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/9580765adfda477cb3ec7bd5b17253d0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/481631f051d14c1cbaba5b453f231b7b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/77ae963471ef4c05ab21be0def3fc5ae, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/8dae8c1a9f4a4a8697ea6f6e2ec91e67] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp, totalSize=25.3 K 2023-02-13 04:55:52,472 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 1817ae7ae0f64f919a4ad0f9f01892d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264142630 2023-02-13 04:55:52,472 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 9580765adfda477cb3ec7bd5b17253d0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264144411 2023-02-13 04:55:52,473 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 481631f051d14c1cbaba5b453f231b7b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264146197 2023-02-13 04:55:52,473 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 77ae963471ef4c05ab21be0def3fc5ae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264147600 2023-02-13 04:55:52,473 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 8dae8c1a9f4a4a8697ea6f6e2ec91e67, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:55:52,482 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 7e59983b3de5930ab2ae0397fa6dba0d#family2#compaction#150 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:52,489 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213e5b76c562d644dddaed9f81b9bf4bf6a_del 2023-02-13 04:55:52,489 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213e5b76c562d644dddaed9f81b9bf4bf6a_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213e5b76c562d644dddaed9f81b9bf4bf6a_del 2023-02-13 04:55:52,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9efb0182ecf947e0954e076a05c70e66, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9438d28a65154763a93ddc7c523a237b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/802f37edd1d4460d96b588e45521cad5, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/ad637709344e441593a29c9fc4e82eaa, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/2decdbcb5f4a4664846531095c0ba745] to archive 2023-02-13 04:55:52,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:52,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9efb0182ecf947e0954e076a05c70e66 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9efb0182ecf947e0954e076a05c70e66 2023-02-13 04:55:52,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9438d28a65154763a93ddc7c523a237b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/9438d28a65154763a93ddc7c523a237b 2023-02-13 04:55:52,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/802f37edd1d4460d96b588e45521cad5 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/802f37edd1d4460d96b588e45521cad5 2023-02-13 04:55:52,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/ad637709344e441593a29c9fc4e82eaa to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/ad637709344e441593a29c9fc4e82eaa 2023-02-13 04:55:52,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/2decdbcb5f4a4664846531095c0ba745 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/2decdbcb5f4a4664846531095c0ba745 2023-02-13 04:55:53,301 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 844589c1997b428c92098c808272895b 2023-02-13 04:55:53,302 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/.tmp/family2/844589c1997b428c92098c808272895b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/844589c1997b428c92098c808272895b 2023-02-13 04:55:53,305 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 844589c1997b428c92098c808272895b 2023-02-13 04:55:53,306 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7e59983b3de5930ab2ae0397fa6dba0d/family2 of 7e59983b3de5930ab2ae0397fa6dba0d into 844589c1997b428c92098c808272895b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:55:53,306 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 7e59983b3de5930ab2ae0397fa6dba0d: 2023-02-13 04:55:53,306 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:53,306 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 48697bb307a98b9544461b85dd69ae57/family1 is initiating major compaction (all files) 2023-02-13 04:55:53,306 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:53,306 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:53,307 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 48697bb307a98b9544461b85dd69ae57/family1 in ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:53,307 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/c667631556e44cfc8d48eab1bd4d6a25, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/065b1c8085e24e81a05be3050faebb04, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/a52cb9ac835a4b45af3adc9fca283dd7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/9df1f2c3a1ac43749058ea7cf47a8a7c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/0cf6e1554201464890bcb201b38ca4a2] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp, totalSize=26.6 K 2023-02-13 04:55:53,307 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting c667631556e44cfc8d48eab1bd4d6a25, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264142631 2023-02-13 04:55:53,308 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 065b1c8085e24e81a05be3050faebb04, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264144412 2023-02-13 04:55:53,308 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting a52cb9ac835a4b45af3adc9fca283dd7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264146197 2023-02-13 04:55:53,308 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 9df1f2c3a1ac43749058ea7cf47a8a7c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264147600 2023-02-13 04:55:53,308 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 0cf6e1554201464890bcb201b38ca4a2, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:55:53,316 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 48697bb307a98b9544461b85dd69ae57#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:53,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/1817ae7ae0f64f919a4ad0f9f01892d1, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/9580765adfda477cb3ec7bd5b17253d0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/481631f051d14c1cbaba5b453f231b7b, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/77ae963471ef4c05ab21be0def3fc5ae, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/8dae8c1a9f4a4a8697ea6f6e2ec91e67] to archive 2023-02-13 04:55:53,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:53,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/1817ae7ae0f64f919a4ad0f9f01892d1 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/1817ae7ae0f64f919a4ad0f9f01892d1 2023-02-13 04:55:53,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/9580765adfda477cb3ec7bd5b17253d0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/9580765adfda477cb3ec7bd5b17253d0 2023-02-13 04:55:53,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/481631f051d14c1cbaba5b453f231b7b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/481631f051d14c1cbaba5b453f231b7b 2023-02-13 04:55:53,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/77ae963471ef4c05ab21be0def3fc5ae to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/77ae963471ef4c05ab21be0def3fc5ae 2023-02-13 04:55:53,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/8dae8c1a9f4a4a8697ea6f6e2ec91e67 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family2/8dae8c1a9f4a4a8697ea6f6e2ec91e67 2023-02-13 04:55:53,722 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302134502e6600b594b049b0e58fc1b8391aa_del 2023-02-13 04:55:53,722 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302134502e6600b594b049b0e58fc1b8391aa_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302134502e6600b594b049b0e58fc1b8391aa_del 2023-02-13 04:55:54,535 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4db98174aae4f9189c6ea88cb21826b 2023-02-13 04:55:54,535 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family1/c4db98174aae4f9189c6ea88cb21826b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/c4db98174aae4f9189c6ea88cb21826b 2023-02-13 04:55:54,539 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4db98174aae4f9189c6ea88cb21826b 2023-02-13 04:55:54,539 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 48697bb307a98b9544461b85dd69ae57/family1 of 48697bb307a98b9544461b85dd69ae57 into c4db98174aae4f9189c6ea88cb21826b(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:54,539 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 48697bb307a98b9544461b85dd69ae57: 2023-02-13 04:55:54,540 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:54,540 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 48697bb307a98b9544461b85dd69ae57/family2 is initiating major compaction (all files) 2023-02-13 04:55:54,540 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:54,540 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:54,541 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 48697bb307a98b9544461b85dd69ae57/family2 in ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:55:54,541 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c869e3c0189f4f5d9db0806a71bcb904, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/975b4cd0f69d4ace813c2327b2bea12f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c3f4e81393fc421fa5c0f58276a110e0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/fa756ad2f79b46a19eb90f43a129820f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/6ed88c445fc6470290ecf9a2d669b588] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp, totalSize=25.3 K 2023-02-13 04:55:54,541 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting c869e3c0189f4f5d9db0806a71bcb904, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264142631 2023-02-13 04:55:54,541 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 975b4cd0f69d4ace813c2327b2bea12f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264144412 2023-02-13 04:55:54,542 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting c3f4e81393fc421fa5c0f58276a110e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264146197 2023-02-13 04:55:54,542 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting fa756ad2f79b46a19eb90f43a129820f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264147600 2023-02-13 04:55:54,542 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 6ed88c445fc6470290ecf9a2d669b588, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:55:54,549 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 48697bb307a98b9544461b85dd69ae57#family2#compaction#152 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:54,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/c667631556e44cfc8d48eab1bd4d6a25, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/065b1c8085e24e81a05be3050faebb04, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/a52cb9ac835a4b45af3adc9fca283dd7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/9df1f2c3a1ac43749058ea7cf47a8a7c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/0cf6e1554201464890bcb201b38ca4a2] to archive 2023-02-13 04:55:54,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:54,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/c667631556e44cfc8d48eab1bd4d6a25 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/c667631556e44cfc8d48eab1bd4d6a25 2023-02-13 04:55:54,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/065b1c8085e24e81a05be3050faebb04 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/065b1c8085e24e81a05be3050faebb04 2023-02-13 04:55:54,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/a52cb9ac835a4b45af3adc9fca283dd7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/a52cb9ac835a4b45af3adc9fca283dd7 2023-02-13 04:55:54,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/9df1f2c3a1ac43749058ea7cf47a8a7c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/9df1f2c3a1ac43749058ea7cf47a8a7c 2023-02-13 04:55:54,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/0cf6e1554201464890bcb201b38ca4a2 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/0cf6e1554201464890bcb201b38ca4a2 2023-02-13 04:55:54,957 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213e18c6609eb82480192e894cf732441a8_del 2023-02-13 04:55:54,957 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213e18c6609eb82480192e894cf732441a8_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213e18c6609eb82480192e894cf732441a8_del 2023-02-13 04:55:55,770 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 147ae2b464e046a18ae3a230c8aec6dd 2023-02-13 04:55:55,770 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/.tmp/family2/147ae2b464e046a18ae3a230c8aec6dd as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/147ae2b464e046a18ae3a230c8aec6dd 2023-02-13 04:55:55,774 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 147ae2b464e046a18ae3a230c8aec6dd 2023-02-13 04:55:55,775 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 48697bb307a98b9544461b85dd69ae57/family2 of 48697bb307a98b9544461b85dd69ae57 into 147ae2b464e046a18ae3a230c8aec6dd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:55,775 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 48697bb307a98b9544461b85dd69ae57: 2023-02-13 04:55:55,775 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:55,775 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 761c0e5bb8f03a25298dfc51c2ad6940/family1 is initiating major compaction (all files) 2023-02-13 04:55:55,775 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:55,775 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:55,775 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 761c0e5bb8f03a25298dfc51c2ad6940/family1 in ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:55,775 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/4ccf4a11b14448ae914d5ee87092f834, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8b9b2cb92fc44799a593cfdca15e0d83, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8e0377fa91c6439a8480803995835d58, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/5727bc749434447fa077b5acbdd31b78, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/1dec1e5570404f6f802de7760887fcd9] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp, totalSize=26.6 K 2023-02-13 04:55:55,776 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 4ccf4a11b14448ae914d5ee87092f834, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264142631 2023-02-13 04:55:55,776 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 8b9b2cb92fc44799a593cfdca15e0d83, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264144412 2023-02-13 04:55:55,776 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 8e0377fa91c6439a8480803995835d58, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264146197 2023-02-13 04:55:55,776 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 5727bc749434447fa077b5acbdd31b78, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264147600 2023-02-13 04:55:55,777 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 1dec1e5570404f6f802de7760887fcd9, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:55:55,784 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 761c0e5bb8f03a25298dfc51c2ad6940#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:55,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c869e3c0189f4f5d9db0806a71bcb904, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/975b4cd0f69d4ace813c2327b2bea12f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c3f4e81393fc421fa5c0f58276a110e0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/fa756ad2f79b46a19eb90f43a129820f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/6ed88c445fc6470290ecf9a2d669b588] to archive 2023-02-13 04:55:55,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:55,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c869e3c0189f4f5d9db0806a71bcb904 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c869e3c0189f4f5d9db0806a71bcb904 2023-02-13 04:55:55,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/975b4cd0f69d4ace813c2327b2bea12f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/975b4cd0f69d4ace813c2327b2bea12f 2023-02-13 04:55:55,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c3f4e81393fc421fa5c0f58276a110e0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/c3f4e81393fc421fa5c0f58276a110e0 2023-02-13 04:55:55,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/fa756ad2f79b46a19eb90f43a129820f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/fa756ad2f79b46a19eb90f43a129820f 2023-02-13 04:55:55,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/6ed88c445fc6470290ecf9a2d669b588 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family2/6ed88c445fc6470290ecf9a2d669b588 2023-02-13 04:55:56,191 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021391bfea038f9d499f8b841845851f6a0c_del 2023-02-13 04:55:56,192 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021391bfea038f9d499f8b841845851f6a0c_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021391bfea038f9d499f8b841845851f6a0c_del 2023-02-13 04:55:57,004 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81ad819edb7e4de6988d67ea1d3d17f0 2023-02-13 04:55:57,004 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family1/81ad819edb7e4de6988d67ea1d3d17f0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/81ad819edb7e4de6988d67ea1d3d17f0 2023-02-13 04:55:57,007 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81ad819edb7e4de6988d67ea1d3d17f0 2023-02-13 04:55:57,008 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 761c0e5bb8f03a25298dfc51c2ad6940/family1 of 761c0e5bb8f03a25298dfc51c2ad6940 into 81ad819edb7e4de6988d67ea1d3d17f0(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:57,008 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 761c0e5bb8f03a25298dfc51c2ad6940: 2023-02-13 04:55:57,008 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:55:57,008 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 761c0e5bb8f03a25298dfc51c2ad6940/family2 is initiating major compaction (all files) 2023-02-13 04:55:57,009 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:55:57,009 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:55:57,009 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 761c0e5bb8f03a25298dfc51c2ad6940/family2 in ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:55:57,009 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/ddaee16ec8734007a3db002cc717de95, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/40dcb85b088149549c2f5d4e91c5412a, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/33c6e449bf4747b8b129ca2605c95783, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/3a792b30363e4adb8d6298c251b0d7f7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/c43fd97dba3845ee924671a3f92dbe10] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp, totalSize=25.3 K 2023-02-13 04:55:57,009 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting ddaee16ec8734007a3db002cc717de95, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264142631 2023-02-13 04:55:57,009 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 40dcb85b088149549c2f5d4e91c5412a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264144412 2023-02-13 04:55:57,010 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 33c6e449bf4747b8b129ca2605c95783, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264146197 2023-02-13 04:55:57,010 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 3a792b30363e4adb8d6298c251b0d7f7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264147600 2023-02-13 04:55:57,010 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting c43fd97dba3845ee924671a3f92dbe10, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:55:57,018 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 761c0e5bb8f03a25298dfc51c2ad6940#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:55:57,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/4ccf4a11b14448ae914d5ee87092f834, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8b9b2cb92fc44799a593cfdca15e0d83, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8e0377fa91c6439a8480803995835d58, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/5727bc749434447fa077b5acbdd31b78, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/1dec1e5570404f6f802de7760887fcd9] to archive 2023-02-13 04:55:57,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:57,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/4ccf4a11b14448ae914d5ee87092f834 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/4ccf4a11b14448ae914d5ee87092f834 2023-02-13 04:55:57,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8b9b2cb92fc44799a593cfdca15e0d83 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8b9b2cb92fc44799a593cfdca15e0d83 2023-02-13 04:55:57,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8e0377fa91c6439a8480803995835d58 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/8e0377fa91c6439a8480803995835d58 2023-02-13 04:55:57,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/5727bc749434447fa077b5acbdd31b78 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/5727bc749434447fa077b5acbdd31b78 2023-02-13 04:55:57,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/1dec1e5570404f6f802de7760887fcd9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/1dec1e5570404f6f802de7760887fcd9 2023-02-13 04:55:57,425 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021368b3c759e679481887d04dadb83aec3d_del 2023-02-13 04:55:57,425 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021368b3c759e679481887d04dadb83aec3d_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021368b3c759e679481887d04dadb83aec3d_del 2023-02-13 04:55:58,237 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95f263eb7cb44ef9b5848b71d0e20b12 2023-02-13 04:55:58,238 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/.tmp/family2/95f263eb7cb44ef9b5848b71d0e20b12 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/95f263eb7cb44ef9b5848b71d0e20b12 2023-02-13 04:55:58,241 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95f263eb7cb44ef9b5848b71d0e20b12 2023-02-13 04:55:58,242 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 761c0e5bb8f03a25298dfc51c2ad6940/family2 of 761c0e5bb8f03a25298dfc51c2ad6940 into 95f263eb7cb44ef9b5848b71d0e20b12(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:55:58,242 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 761c0e5bb8f03a25298dfc51c2ad6940: 2023-02-13 04:55:58,245 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:58,248 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:58,251 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:58,251 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:58,255 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 04:55:58,267 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-13 04:55:58,269 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213c308a0d3103b48ed8d2e587dd752881a_del 2023-02-13 04:55:58,272 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302134502e6600b594b049b0e58fc1b8391aa_del 2023-02-13 04:55:58,274 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021391bfea038f9d499f8b841845851f6a0c_del 2023-02-13 04:55:58,274 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-13 04:55:58,274 DEBUG [Listener at localhost/37751] zookeeper.ReadOnlyZKClient(139): Connect 0x48ee0a65 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:55:58,279 DEBUG [Listener at localhost/37751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd9506e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:55:58,280 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 04:55:58,280 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 04:55:58,280 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 04:55:58,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/ddaee16ec8734007a3db002cc717de95, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/40dcb85b088149549c2f5d4e91c5412a, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/33c6e449bf4747b8b129ca2605c95783, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/3a792b30363e4adb8d6298c251b0d7f7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/c43fd97dba3845ee924671a3f92dbe10] to archive 2023-02-13 04:55:58,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:58,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/ddaee16ec8734007a3db002cc717de95 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/ddaee16ec8734007a3db002cc717de95 2023-02-13 04:55:58,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/40dcb85b088149549c2f5d4e91c5412a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/40dcb85b088149549c2f5d4e91c5412a 2023-02-13 04:55:58,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/33c6e449bf4747b8b129ca2605c95783 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/33c6e449bf4747b8b129ca2605c95783 2023-02-13 04:55:58,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/3a792b30363e4adb8d6298c251b0d7f7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/3a792b30363e4adb8d6298c251b0d7f7 2023-02-13 04:55:58,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/c43fd97dba3845ee924671a3f92dbe10 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family2/c43fd97dba3845ee924671a3f92dbe10 2023-02-13 04:55:58,699 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021331a88745b2fb45b19ea923dea8d58787 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021331a88745b2fb45b19ea923dea8d58787 2023-02-13 04:55:58,699 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 04:55:58,711 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:55:58,714 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47074, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:55:58,719 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:55:58,722 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:55:58,730 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/09450897c3d64a1eb9d7829345f80f7a first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-13 04:55:58,731 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/09450897c3d64a1eb9d7829345f80f7a}] 2023-02-13 04:55:58,735 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/09450897c3d64a1eb9d7829345f80f7a for inclusion in 7e59983b3de5930ab2ae0397fa6dba0d/family1 2023-02-13 04:55:58,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-13 04:55:58,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 04:55:58,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 7e59983b3de5930ab2ae0397fa6dba0d: 2023-02-13 04:55:58,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/09450897c3d64a1eb9d7829345f80f7a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__89caank7uol4e75vi8ntq69nst15vou8gs3spajdnti2b8gp6cm21rhajfudc17n/family1/09450897c3d64a1eb9d7829345f80f7a 2023-02-13 04:55:58,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__89caank7uol4e75vi8ntq69nst15vou8gs3spajdnti2b8gp6cm21rhajfudc17n/family1/09450897c3d64a1eb9d7829345f80f7a as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/674561b992184f69b4e9123dd586badd_SeqId_28_ 2023-02-13 04:55:58,740 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__89caank7uol4e75vi8ntq69nst15vou8gs3spajdnti2b8gp6cm21rhajfudc17n/family1/09450897c3d64a1eb9d7829345f80f7a into 7e59983b3de5930ab2ae0397fa6dba0d/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/674561b992184f69b4e9123dd586badd_SeqId_28_ - updating store file list. 2023-02-13 04:55:58,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/674561b992184f69b4e9123dd586badd_SeqId_28_ into 7e59983b3de5930ab2ae0397fa6dba0d/family1 2023-02-13 04:55:58,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__89caank7uol4e75vi8ntq69nst15vou8gs3spajdnti2b8gp6cm21rhajfudc17n/family1/09450897c3d64a1eb9d7829345f80f7a into 7e59983b3de5930ab2ae0397fa6dba0d/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/family1/674561b992184f69b4e9123dd586badd_SeqId_28_) 2023-02-13 04:55:58,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__89caank7uol4e75vi8ntq69nst15vou8gs3spajdnti2b8gp6cm21rhajfudc17n/family1/09450897c3d64a1eb9d7829345f80f7a 2023-02-13 04:55:58,745 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 04:55:58,746 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:58,747 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302134ead6743525c4174a51e1025b66562b4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302134ead6743525c4174a51e1025b66562b4 2023-02-13 04:55:58,747 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 04:55:58,747 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 04:55:58,748 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 04:55:59,099 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302136e8d8a76bf354aef87a06be7618bfd5e to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302136e8d8a76bf354aef87a06be7618bfd5e 2023-02-13 04:55:59,099 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021395855ac758cd49d1a018f7814a6ccb45 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021395855ac758cd49d1a018f7814a6ccb45 2023-02-13 04:55:59,100 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 04:55:59,100 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 04:55:59,124 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/dac84bc35c8a49b69b3d6dbe40c6b944 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-13 04:55:59,124 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/814389316e1c404bacd93f232e503227 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-13 04:55:59,124 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/dac84bc35c8a49b69b3d6dbe40c6b944}] 2023-02-13 04:55:59,125 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/814389316e1c404bacd93f232e503227}] 2023-02-13 04:55:59,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/dac84bc35c8a49b69b3d6dbe40c6b944 for inclusion in 48697bb307a98b9544461b85dd69ae57/family1 2023-02-13 04:55:59,127 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/814389316e1c404bacd93f232e503227 for inclusion in 761c0e5bb8f03a25298dfc51c2ad6940/family1 2023-02-13 04:55:59,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-13 04:55:59,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 04:55:59,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-13 04:55:59,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 761c0e5bb8f03a25298dfc51c2ad6940: 2023-02-13 04:55:59,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 04:55:59,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 48697bb307a98b9544461b85dd69ae57: 2023-02-13 04:55:59,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/814389316e1c404bacd93f232e503227 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__7c622fpf186ltdurvak4tsfuphogpkt1cepbpct40i1v7uhedlt1qqcr147g5ghe/family1/814389316e1c404bacd93f232e503227 2023-02-13 04:55:59,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/dac84bc35c8a49b69b3d6dbe40c6b944 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__l1keoj8c5psb37mjhh1p85pb6qtdgdncmb91t9nc58ukudgfup0aqearo4j6u4nv/family1/dac84bc35c8a49b69b3d6dbe40c6b944 2023-02-13 04:55:59,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__7c622fpf186ltdurvak4tsfuphogpkt1cepbpct40i1v7uhedlt1qqcr147g5ghe/family1/814389316e1c404bacd93f232e503227 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/835096cf4f9841adae1c8f6934e96bac_SeqId_28_ 2023-02-13 04:55:59,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__l1keoj8c5psb37mjhh1p85pb6qtdgdncmb91t9nc58ukudgfup0aqearo4j6u4nv/family1/dac84bc35c8a49b69b3d6dbe40c6b944 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/d263683706894272b120043f5db524e8_SeqId_28_ 2023-02-13 04:55:59,132 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__7c622fpf186ltdurvak4tsfuphogpkt1cepbpct40i1v7uhedlt1qqcr147g5ghe/family1/814389316e1c404bacd93f232e503227 into 761c0e5bb8f03a25298dfc51c2ad6940/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/835096cf4f9841adae1c8f6934e96bac_SeqId_28_ - updating store file list. 2023-02-13 04:55:59,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__l1keoj8c5psb37mjhh1p85pb6qtdgdncmb91t9nc58ukudgfup0aqearo4j6u4nv/family1/dac84bc35c8a49b69b3d6dbe40c6b944 into 48697bb307a98b9544461b85dd69ae57/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/d263683706894272b120043f5db524e8_SeqId_28_ - updating store file list. 2023-02-13 04:55:59,135 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/835096cf4f9841adae1c8f6934e96bac_SeqId_28_ into 761c0e5bb8f03a25298dfc51c2ad6940/family1 2023-02-13 04:55:59,135 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__7c622fpf186ltdurvak4tsfuphogpkt1cepbpct40i1v7uhedlt1qqcr147g5ghe/family1/814389316e1c404bacd93f232e503227 into 761c0e5bb8f03a25298dfc51c2ad6940/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/family1/835096cf4f9841adae1c8f6934e96bac_SeqId_28_) 2023-02-13 04:55:59,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/d263683706894272b120043f5db524e8_SeqId_28_ into 48697bb307a98b9544461b85dd69ae57/family1 2023-02-13 04:55:59,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__l1keoj8c5psb37mjhh1p85pb6qtdgdncmb91t9nc58ukudgfup0aqearo4j6u4nv/family1/dac84bc35c8a49b69b3d6dbe40c6b944 into 48697bb307a98b9544461b85dd69ae57/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/family1/d263683706894272b120043f5db524e8_SeqId_28_) 2023-02-13 04:55:59,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__7c622fpf186ltdurvak4tsfuphogpkt1cepbpct40i1v7uhedlt1qqcr147g5ghe/family1/814389316e1c404bacd93f232e503227 2023-02-13 04:55:59,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__ns_testMinorCompaction__l1keoj8c5psb37mjhh1p85pb6qtdgdncmb91t9nc58ukudgfup0aqearo4j6u4nv/family1/dac84bc35c8a49b69b3d6dbe40c6b944 2023-02-13 04:55:59,137 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 04:55:59,137 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 04:55:59,137 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:59,138 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:55:59,139 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302135cc8a15b0c784065993d1f89f988af3d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302135cc8a15b0c784065993d1f89f988af3d 2023-02-13 04:55:59,139 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 04:55:59,139 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 04:55:59,139 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021398da70878e40466fbd589ccb7c28bfb5 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021398da70878e40466fbd589ccb7c28bfb5 2023-02-13 04:55:59,139 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 04:55:59,139 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 04:55:59,139 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 04:55:59,139 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 04:55:59,139 INFO [Listener at localhost/37751] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-13 04:55:59,141 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:59,143 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:59,145 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:55:59,146 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:55:59,161 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=249 (was 286), OpenFileDescriptor=633 (was 763), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=133 (was 165), ProcessCount=168 (was 168), AvailableMemoryMB=3523 (was 3542) 2023-02-13 04:55:59,171 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=633, MaxFileDescriptor=60000, SystemLoadAverage=133, ProcessCount=168, AvailableMemoryMB=3523 2023-02-13 04:55:59,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 04:55:59,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-13 04:55:59,174 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:55:59,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-13 04:55:59,175 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:55:59,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 04:55:59,176 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:55:59,176 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f empty. 2023-02-13 04:55:59,177 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:55:59,177 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-13 04:55:59,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 04:55:59,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 04:55:59,583 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 04:55:59,584 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5da706e80ec7bbb4fd54525c6463321f, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:55:59,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 04:55:59,989 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:55:59,989 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 5da706e80ec7bbb4fd54525c6463321f, disabling compactions & flushes 2023-02-13 04:55:59,989 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:55:59,989 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:55:59,989 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. after waiting 0 ms 2023-02-13 04:55:59,989 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:55:59,989 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:55:59,989 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 5da706e80ec7bbb4fd54525c6463321f: Waiting for close lock at 1676264159989Disabling compacts and flushes for region at 1676264159989Disabling writes for close at 1676264159989Writing region close event to WAL at 1676264159989Closed at 1676264159989 2023-02-13 04:55:59,991 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:55:59,992 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676264159992"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264159992"}]},"ts":"1676264159992"} 2023-02-13 04:55:59,993 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:55:59,994 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:55:59,994 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264159994"}]},"ts":"1676264159994"} 2023-02-13 04:55:59,994 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 04:55:59,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=5da706e80ec7bbb4fd54525c6463321f, ASSIGN}] 2023-02-13 04:55:59,998 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=5da706e80ec7bbb4fd54525c6463321f, ASSIGN 2023-02-13 04:55:59,999 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=5da706e80ec7bbb4fd54525c6463321f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:56:00,150 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=5da706e80ec7bbb4fd54525c6463321f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:00,150 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676264160150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264160150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264160150"}]},"ts":"1676264160150"} 2023-02-13 04:56:00,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 5da706e80ec7bbb4fd54525c6463321f, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:56:00,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 04:56:00,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:00,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5da706e80ec7bbb4fd54525c6463321f, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:56:00,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:56:00,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:56:00,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:56:00,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:56:00,306 INFO [StoreOpener-5da706e80ec7bbb4fd54525c6463321f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:56:00,307 DEBUG [StoreOpener-5da706e80ec7bbb4fd54525c6463321f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1 2023-02-13 04:56:00,307 DEBUG [StoreOpener-5da706e80ec7bbb4fd54525c6463321f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1 2023-02-13 04:56:00,308 INFO [StoreOpener-5da706e80ec7bbb4fd54525c6463321f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5da706e80ec7bbb4fd54525c6463321f columnFamilyName family1 2023-02-13 04:56:00,309 INFO [StoreOpener-5da706e80ec7bbb4fd54525c6463321f-1] regionserver.HStore(310): Store=5da706e80ec7bbb4fd54525c6463321f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:56:00,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:56:00,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:56:00,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:56:00,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:56:00,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5da706e80ec7bbb4fd54525c6463321f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74724550, jitterRate=0.11348256468772888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:56:00,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5da706e80ec7bbb4fd54525c6463321f: Running coprocessor pre-open hook at 1676264160305Writing region info on filesystem at 1676264160305Initializing all the Stores at 1676264160306 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676264160306Cleaning up temporary data from old regions at 1676264160310 (+4 ms)Cleaning up detritus from prior splits at 1676264160310Running coprocessor post-open hooks at 1676264160313 (+3 ms)Region opened successfully at 1676264160313 2023-02-13 04:56:00,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f., pid=114, masterSystemTime=1676264160302 2023-02-13 04:56:00,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:00,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:00,315 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=5da706e80ec7bbb4fd54525c6463321f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:00,315 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676264160315"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264160315"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264160315"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264160315"}]},"ts":"1676264160315"} 2023-02-13 04:56:00,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-13 04:56:00,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 5da706e80ec7bbb4fd54525c6463321f, server=jenkins-hbase4.apache.org,37513,1676264019660 in 165 msec 2023-02-13 04:56:00,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-13 04:56:00,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=5da706e80ec7bbb4fd54525c6463321f, ASSIGN in 320 msec 2023-02-13 04:56:00,319 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:56:00,319 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264160319"}]},"ts":"1676264160319"} 2023-02-13 04:56:00,320 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 04:56:00,322 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:56:00,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1490 sec 2023-02-13 04:56:01,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 04:56:01,280 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-13 04:56:01,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:01,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:01,297 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:01,297 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:01,297 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:01,297 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:01,297 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:01,298 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:01,299 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:01,299 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:01,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:01,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:01,299 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:01,299 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:01,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:01,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:01,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:01,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:01,300 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:01,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:01,300 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:01,300 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:01,300 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:01,300 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:01,300 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:01,300 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:01,300 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:01,301 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 04:56:01,721 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113065eb663be7f64c5abcbf3514d74b0af9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113065eb663be7f64c5abcbf3514d74b0af9 2023-02-13 04:56:02,125 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/9f6769c618db4c75b1fc254742a6977a 2023-02-13 04:56:02,128 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/9f6769c618db4c75b1fc254742a6977a as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9f6769c618db4c75b1fc254742a6977a 2023-02-13 04:56:02,131 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9f6769c618db4c75b1fc254742a6977a, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 04:56:02,132 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 831ms, sequenceid=5, compaction requested=false 2023-02-13 04:56:02,132 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:02,132 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:02,132 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:02,132 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:02,132 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:02,132 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,132 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:02,132 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:02,134 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,134 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:02,134 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,134 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:02,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:02,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1378c8b9[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:02,136 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:02,136 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,137 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,137 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:02,137 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:02,137 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:02,137 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,138 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:02,139 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:02,139 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,140 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:02,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:02,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:02,142 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:02,142 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:02,142 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:02,142 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,142 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:02,143 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,143 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:02,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,143 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:02,144 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,145 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:02,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:02,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:02,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:02,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:02,147 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:02,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:02,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:02,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:02,147 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,248 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:02,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:02,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:02,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:02,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,253 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:02,253 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:02,254 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:02,254 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:02,254 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,254 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,255 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,255 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:02,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:02,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:02,255 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:02,255 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:56:02,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:02,257 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:02,257 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:02,257 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:02,257 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:02,257 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:02,257 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:02,257 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:02,257 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 04:56:02,669 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128aa899ae5ff664428916751ffc4647433 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128aa899ae5ff664428916751ffc4647433 2023-02-13 04:56:03,074 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/1285af927e8c43c9b7beb78fb0091b71 2023-02-13 04:56:03,077 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/1285af927e8c43c9b7beb78fb0091b71 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/1285af927e8c43c9b7beb78fb0091b71 2023-02-13 04:56:03,080 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/1285af927e8c43c9b7beb78fb0091b71, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 04:56:03,081 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 824ms, sequenceid=9, compaction requested=false 2023-02-13 04:56:03,081 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:03,081 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,083 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:03,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:03,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e99b927[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:03,084 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:03,084 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,085 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,086 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:03,086 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,086 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:03,086 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:03,086 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:03,088 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:03,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:03,090 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:03,090 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:03,090 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:03,090 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,090 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:03,091 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,091 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:03,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,091 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:03,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:03,092 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,093 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,094 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,094 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:03,094 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,094 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:03,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:56:03,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:03,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:03,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:03,094 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:03,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,095 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:03,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:03,095 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,095 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:03,195 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:03,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:03,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:03,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:03,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,201 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:03,201 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:03,201 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:03,201 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:03,201 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,201 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,207 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,207 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:03,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:03,207 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:03,207 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:03,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:03,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,208 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,208 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:56:03,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:03,208 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:03,208 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:03,208 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:03,208 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:03,208 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:03,208 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:03,209 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:03,209 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:56:03,618 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201980c533d93de402787e8bfc6e08df258 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201980c533d93de402787e8bfc6e08df258 2023-02-13 04:56:04,023 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/e1a2a58cad9b42199fac1fb8bb6e01ac 2023-02-13 04:56:04,026 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/e1a2a58cad9b42199fac1fb8bb6e01ac as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/e1a2a58cad9b42199fac1fb8bb6e01ac 2023-02-13 04:56:04,029 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/e1a2a58cad9b42199fac1fb8bb6e01ac, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 04:56:04,030 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 821ms, sequenceid=13, compaction requested=true 2023-02-13 04:56:04,030 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:04,030 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:04,030 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:04,030 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:04,030 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,031 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:04,031 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:04,032 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,032 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:04,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:04,032 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:04,032 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:04,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:04,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:04,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:04,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c9ab9f8[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:04,033 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:04,034 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,035 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,035 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:04,035 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:04,035 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:04,035 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,035 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:04,036 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:04,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:04,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:04,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:04,038 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:04,038 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:04,038 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:04,038 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,038 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:04,040 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,040 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,040 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:04,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,041 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:04,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,042 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:04,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:04,044 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:04,044 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,144 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:04,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:04,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:04,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:04,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,150 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:04,150 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:04,150 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:04,150 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:04,150 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,150 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,151 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,151 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:04,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:04,152 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,152 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,152 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,153 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:56:04,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:04,153 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:04,153 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:04,153 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:04,153 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:56:04,563 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120524034e4ec2fe4cdcb845ec4760e2bdfd to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120524034e4ec2fe4cdcb845ec4760e2bdfd 2023-02-13 04:56:04,967 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/de8b6eb24257475cbc11b966eaf5f356 2023-02-13 04:56:04,972 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/de8b6eb24257475cbc11b966eaf5f356 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/de8b6eb24257475cbc11b966eaf5f356 2023-02-13 04:56:04,976 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/de8b6eb24257475cbc11b966eaf5f356, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 04:56:04,976 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 823ms, sequenceid=17, compaction requested=true 2023-02-13 04:56:04,977 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:04,977 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:04,977 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:04,978 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,978 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:04,979 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,979 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:04,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:04,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15567c8a[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:04,980 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:04,980 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,982 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,982 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:04,982 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,982 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:04,982 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:04,982 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:04,984 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:04,984 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,984 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:04,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:04,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:04,984 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:04,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:04,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:04,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:04,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:04,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:04,986 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:04,986 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:04,986 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:04,986 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,986 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:04,987 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,987 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:04,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,987 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:04,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:04,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:04,988 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,989 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,990 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,990 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,991 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,991 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:04,991 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:04,991 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:04,991 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:56:04,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:04,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:04,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:04,991 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:04,991 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,991 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:04,991 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:04,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:04,991 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:05,091 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:05,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:05,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:05,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:05,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,097 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:05,097 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:05,097 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:05,097 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:05,097 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,097 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,099 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:05,099 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:05,100 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,100 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,100 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:56:05,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,100 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:05,100 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:05,100 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:05,101 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:05,101 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:05,101 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:05,101 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:05,101 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:56:05,511 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122898f3011e06fc42c09d9adeafa1191a87 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122898f3011e06fc42c09d9adeafa1191a87 2023-02-13 04:56:05,519 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/0d632a813fee4d528b20922a24925090 2023-02-13 04:56:05,522 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/0d632a813fee4d528b20922a24925090 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/0d632a813fee4d528b20922a24925090 2023-02-13 04:56:05,526 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/0d632a813fee4d528b20922a24925090, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 04:56:05,527 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 426ms, sequenceid=21, compaction requested=true 2023-02-13 04:56:05,527 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:05,527 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:05,527 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:05,527 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:05,527 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,527 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:05,527 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:05,528 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,528 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:05,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:05,529 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,529 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:05,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:05,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:05,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:05,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:05,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@403e5399[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:05,530 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:05,530 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,531 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,531 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:05,531 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:05,531 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:05,531 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,532 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:05,533 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:05,533 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:05,533 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,533 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:05,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:05,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:05,535 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:05,535 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:05,535 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:05,535 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,535 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:05,537 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,537 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:05,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:05,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,537 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:05,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:05,538 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,539 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:05,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,545 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:05,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:05,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:05,545 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:05,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:05,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:05,645 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:05,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:05,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:05,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:05,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,651 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:05,651 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:05,652 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:05,652 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:05,652 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,652 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,653 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,653 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:05,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:05,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:05,654 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:05,654 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:05,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:05,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,655 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,655 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:56:05,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:05,655 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:05,655 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:05,655 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:05,655 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:05,655 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:05,655 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:05,655 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:05,656 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:56:05,843 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:56:06,072 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d831df43612e432da78fe447fbe990ca to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d831df43612e432da78fe447fbe990ca 2023-02-13 04:56:06,476 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/04fc97f97488420ab6a3a8c3d187713d 2023-02-13 04:56:06,480 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/04fc97f97488420ab6a3a8c3d187713d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/04fc97f97488420ab6a3a8c3d187713d 2023-02-13 04:56:06,484 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/04fc97f97488420ab6a3a8c3d187713d, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 04:56:06,485 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 829ms, sequenceid=25, compaction requested=true 2023-02-13 04:56:06,485 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:06,485 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:06,485 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:06,485 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:06,485 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,485 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:06,485 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:06,487 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,487 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:06,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:06,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:06,487 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,487 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:06,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:06,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:06,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:06,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63cd9a38[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:06,489 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:06,489 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,491 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,491 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:06,491 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:06,491 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:06,491 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,491 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:06,493 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:06,493 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,493 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:06,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:06,493 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:06,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:06,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:06,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:06,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:06,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:06,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:06,495 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:06,496 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:06,496 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:06,496 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,496 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:06,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:06,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:06,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,498 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:06,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:06,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,499 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:06,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,501 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,501 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:06,501 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:06,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:06,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:06,501 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,501 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:06,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:56:06,501 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:06,501 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:06,501 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,501 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:06,502 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:06,501 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:06,502 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:06,602 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:06,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:06,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:06,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:06,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,607 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:06,607 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:06,607 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:06,607 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:06,608 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,608 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,610 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,610 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:06,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:06,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:06,611 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:06,611 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:06,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:06,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,611 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,612 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:56:06,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:06,612 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:06,612 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:06,612 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:06,612 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:06,612 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:06,612 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:06,612 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:06,612 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:56:06,622 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101728b67279a5d42dab5170324f1c189ba to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101728b67279a5d42dab5170324f1c189ba 2023-02-13 04:56:07,027 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/372a5cbe4d1c44ffb6152405142a03a3 2023-02-13 04:56:07,031 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/372a5cbe4d1c44ffb6152405142a03a3 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/372a5cbe4d1c44ffb6152405142a03a3 2023-02-13 04:56:07,035 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/372a5cbe4d1c44ffb6152405142a03a3, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 04:56:07,036 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 424ms, sequenceid=29, compaction requested=true 2023-02-13 04:56:07,036 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:07,036 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:07,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:07,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:07,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:07,036 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:07,038 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,038 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:07,038 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,038 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@af1bac0[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:07,040 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:07,040 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,041 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,041 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:07,041 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:07,041 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:07,041 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,041 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:07,042 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:07,042 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:07,042 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,042 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:07,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:07,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:07,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:07,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:07,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:07,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:07,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:07,045 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:07,045 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:07,045 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:07,045 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,045 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:07,053 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,053 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:07,053 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:07,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:07,053 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,055 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,057 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,057 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,057 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,057 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:07,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:07,057 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:07,058 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:07,057 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,057 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:07,058 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,058 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:07,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:56:07,058 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:07,058 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:07,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:07,158 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:07,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:07,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:07,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:07,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,164 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:07,164 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:07,164 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:07,164 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:07,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,165 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,166 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:07,166 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:07,166 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,166 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,167 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,167 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:56:07,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,167 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:07,167 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:07,167 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:07,168 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:07,168 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:07,168 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:07,168 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:07,168 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:56:07,578 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e719f678e8a641edb487d4e8bf0d4021 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103e719f678e8a641edb487d4e8bf0d4021 2023-02-13 04:56:07,582 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/fe0606b0be6142e686e15406ee880eb3 2023-02-13 04:56:07,586 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/fe0606b0be6142e686e15406ee880eb3 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/fe0606b0be6142e686e15406ee880eb3 2023-02-13 04:56:07,589 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/fe0606b0be6142e686e15406ee880eb3, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 04:56:07,589 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 421ms, sequenceid=33, compaction requested=true 2023-02-13 04:56:07,589 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:07,589 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:07,589 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:07,589 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:07,590 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,590 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:07,590 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:07,591 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,591 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:07,591 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,591 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:07,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:07,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c652538[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:07,592 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:07,592 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,599 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:07,600 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:07,600 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,600 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:07,601 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:07,601 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,601 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,601 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:07,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:07,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:07,602 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:07,603 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:07,603 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:07,603 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,603 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:07,604 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,604 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,604 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:07,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:07,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:07,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:07,604 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,605 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,610 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:07,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:07,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:07,611 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:07,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:07,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,611 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:07,711 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:07,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:07,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:07,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:07,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,716 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:07,716 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:07,717 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:07,717 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:07,717 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,717 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,718 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:07,718 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:07,718 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:07,718 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:07,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,719 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,719 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:56:07,719 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:07,719 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:07,719 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:07,719 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:07,720 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:07,720 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:07,720 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:07,720 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:07,720 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:56:08,129 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d11c8cb81bcd46e184f192f0f769ca08 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907d11c8cb81bcd46e184f192f0f769ca08 2023-02-13 04:56:08,534 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/9a2691172906422683203831955b0846 2023-02-13 04:56:08,538 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/9a2691172906422683203831955b0846 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9a2691172906422683203831955b0846 2023-02-13 04:56:08,541 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9a2691172906422683203831955b0846, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 04:56:08,542 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 822ms, sequenceid=37, compaction requested=true 2023-02-13 04:56:08,542 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:08,542 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:08,542 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:08,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,544 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:08,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,544 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:08,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:08,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ef519b6[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:08,546 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:08,546 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,548 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:08,548 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:08,548 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,548 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:08,549 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:08,549 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:08,549 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,550 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:08,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:08,553 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:08,553 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:08,553 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:08,553 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,553 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:08,554 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,554 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,555 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:08,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:08,555 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,556 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,558 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,558 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,558 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:08,558 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:08,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:08,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:08,558 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:08,558 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,559 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:56:08,558 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:08,559 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:08,559 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:08,559 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,559 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:08,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:08,659 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:08,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:08,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:08,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:08,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,664 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:08,664 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:08,664 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 04:56:08,664 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 04:56:08,665 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,665 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,669 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,669 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:08,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:08,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:08,669 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:08,669 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,670 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,670 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 04:56:08,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:08,670 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 04:56:08,670 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:08,670 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 04:56:08,671 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:56:08,671 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:08,671 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:08,671 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. started... 2023-02-13 04:56:08,671 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5da706e80ec7bbb4fd54525c6463321f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 04:56:09,082 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112073cd08dea9314e70b3c4df4478c89321 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112073cd08dea9314e70b3c4df4478c89321 2023-02-13 04:56:09,488 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/b428047052fb4e2ba6c7335c6b897da0 2023-02-13 04:56:09,492 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/b428047052fb4e2ba6c7335c6b897da0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/b428047052fb4e2ba6c7335c6b897da0 2023-02-13 04:56:09,495 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/b428047052fb4e2ba6c7335c6b897da0, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 04:56:09,496 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5da706e80ec7bbb4fd54525c6463321f in 825ms, sequenceid=41, compaction requested=true 2023-02-13 04:56:09,496 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:09,496 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:09,496 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:56:09,496 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:56:09,496 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,496 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 04:56:09,496 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 04:56:09,497 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,497 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:09,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:09,497 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,498 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:09,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:09,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:09,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:09,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 04:56:09,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11e65c0a[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:09,499 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 04:56:09,499 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,500 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,500 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 04:56:09,500 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 04:56:09,500 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:09,500 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,500 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:09,501 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,501 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 04:56:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:09,502 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:09,502 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 04:56:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:09,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:09,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 04:56:09,504 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 04:56:09,504 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:09,504 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:09,504 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,504 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:09,506 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,506 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:09,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,506 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:09,506 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:09,507 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,509 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,509 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:09,509 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:09,509 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:09,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 04:56:09,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:09,509 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,509 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:09,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 04:56:09,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:09,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:09,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:09,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,510 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:09,510 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:09,510 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,610 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:09,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:09,714 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-13 04:56:09,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:56:09,715 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:56:09,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:56:09,716 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264769716 2023-02-13 04:56:09,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 04:56:09,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 04:56:09,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:56:09,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x0697bed6 to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:56:09,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48b696b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:56:09,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:56:10,549 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e0befee1aadc47608a974b914d4d08e1 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103e0befee1aadc47608a974b914d4d08e1 2023-02-13 04:56:10,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:56:10,561 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:56:10,563 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:56:10,568 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:56:10,569 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42440, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:56:10,579 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4421efd73bf143b1af4f1a7fc8a39c45 first=Optional[r5] last=Optional[r6] 2023-02-13 04:56:10,580 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4421efd73bf143b1af4f1a7fc8a39c45}] 2023-02-13 04:56:10,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4421efd73bf143b1af4f1a7fc8a39c45 for inclusion in 5da706e80ec7bbb4fd54525c6463321f/family1 2023-02-13 04:56:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 04:56:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:56:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:10,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/4421efd73bf143b1af4f1a7fc8a39c45 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a4k81a3egr1lhui7ihaudqp6pcv81p4j03ofpas7egl7nf2d4mievdsk187vuuqp/family1/4421efd73bf143b1af4f1a7fc8a39c45 2023-02-13 04:56:10,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a4k81a3egr1lhui7ihaudqp6pcv81p4j03ofpas7egl7nf2d4mievdsk187vuuqp/family1/4421efd73bf143b1af4f1a7fc8a39c45 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/56815cd11c3f47a68d5934b883681236_SeqId_44_ 2023-02-13 04:56:10,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a4k81a3egr1lhui7ihaudqp6pcv81p4j03ofpas7egl7nf2d4mievdsk187vuuqp/family1/4421efd73bf143b1af4f1a7fc8a39c45 into 5da706e80ec7bbb4fd54525c6463321f/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/56815cd11c3f47a68d5934b883681236_SeqId_44_ - updating store file list. 2023-02-13 04:56:10,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/56815cd11c3f47a68d5934b883681236_SeqId_44_ into 5da706e80ec7bbb4fd54525c6463321f/family1 2023-02-13 04:56:10,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a4k81a3egr1lhui7ihaudqp6pcv81p4j03ofpas7egl7nf2d4mievdsk187vuuqp/family1/4421efd73bf143b1af4f1a7fc8a39c45 into 5da706e80ec7bbb4fd54525c6463321f/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/56815cd11c3f47a68d5934b883681236_SeqId_44_) 2023-02-13 04:56:10,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__a4k81a3egr1lhui7ihaudqp6pcv81p4j03ofpas7egl7nf2d4mievdsk187vuuqp/family1/4421efd73bf143b1af4f1a7fc8a39c45 2023-02-13 04:56:10,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 04:56:10,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 04:56:10,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): 5da706e80ec7bbb4fd54525c6463321f/family1 is initiating minor compaction 2023-02-13 04:56:10,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1dcfda17; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:56:10,596 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 5da706e80ec7bbb4fd54525c6463321f/family1 in testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:10,597 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/1285af927e8c43c9b7beb78fb0091b71, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/e1a2a58cad9b42199fac1fb8bb6e01ac, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/de8b6eb24257475cbc11b966eaf5f356, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/0d632a813fee4d528b20922a24925090, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/04fc97f97488420ab6a3a8c3d187713d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/372a5cbe4d1c44ffb6152405142a03a3, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/fe0606b0be6142e686e15406ee880eb3, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9a2691172906422683203831955b0846, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/b428047052fb4e2ba6c7335c6b897da0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/56815cd11c3f47a68d5934b883681236_SeqId_44_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp, totalSize=49.7 K 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 1285af927e8c43c9b7beb78fb0091b71, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting e1a2a58cad9b42199fac1fb8bb6e01ac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting de8b6eb24257475cbc11b966eaf5f356, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 0d632a813fee4d528b20922a24925090, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 04fc97f97488420ab6a3a8c3d187713d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 372a5cbe4d1c44ffb6152405142a03a3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting fe0606b0be6142e686e15406ee880eb3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 9a2691172906422683203831955b0846, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting b428047052fb4e2ba6c7335c6b897da0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 04:56:10,597 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 56815cd11c3f47a68d5934b883681236_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 04:56:10,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:56:10,599 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:10,600 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101728b67279a5d42dab5170324f1c189ba to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101728b67279a5d42dab5170324f1c189ba 2023-02-13 04:56:10,601 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103e719f678e8a641edb487d4e8bf0d4021 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103e719f678e8a641edb487d4e8bf0d4021 2023-02-13 04:56:10,601 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 04:56:10,601 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 04:56:10,602 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:56:10,602 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:56:10,631 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5da706e80ec7bbb4fd54525c6463321f#family1#compaction#165 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:56:11,055 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/29dfe183c7ca4b19bf958ebc68fee024 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/29dfe183c7ca4b19bf958ebc68fee024 2023-02-13 04:56:11,060 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 5da706e80ec7bbb4fd54525c6463321f/family1 of 5da706e80ec7bbb4fd54525c6463321f into 29dfe183c7ca4b19bf958ebc68fee024(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:56:11,060 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:11,060 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676264170596; duration=0sec 2023-02-13 04:56:11,060 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:56:11,064 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123158f3039810554b848411e69516d55a04 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123158f3039810554b848411e69516d55a04 2023-02-13 04:56:11,065 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:56:11,092 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/553c74016c8648c584c5938763c7472b first=Optional[r1] last=Optional[r4] 2023-02-13 04:56:11,093 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/553c74016c8648c584c5938763c7472b}] 2023-02-13 04:56:11,096 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/553c74016c8648c584c5938763c7472b for inclusion in 5da706e80ec7bbb4fd54525c6463321f/family1 2023-02-13 04:56:11,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/1285af927e8c43c9b7beb78fb0091b71, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/e1a2a58cad9b42199fac1fb8bb6e01ac, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/de8b6eb24257475cbc11b966eaf5f356, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/0d632a813fee4d528b20922a24925090, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/04fc97f97488420ab6a3a8c3d187713d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/372a5cbe4d1c44ffb6152405142a03a3, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/fe0606b0be6142e686e15406ee880eb3, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9a2691172906422683203831955b0846, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/b428047052fb4e2ba6c7335c6b897da0, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/56815cd11c3f47a68d5934b883681236_SeqId_44_] to archive 2023-02-13 04:56:11,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:11,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 04:56:11,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:56:11,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:11,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/1285af927e8c43c9b7beb78fb0091b71 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/1285af927e8c43c9b7beb78fb0091b71 2023-02-13 04:56:11,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/553c74016c8648c584c5938763c7472b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jgtpicrrg1vbip9c0ohph96e3qhl7fi8ftrmhccda2s4j7vmu13ntvksl3r89k3h/family1/553c74016c8648c584c5938763c7472b 2023-02-13 04:56:11,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/e1a2a58cad9b42199fac1fb8bb6e01ac to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/e1a2a58cad9b42199fac1fb8bb6e01ac 2023-02-13 04:56:11,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jgtpicrrg1vbip9c0ohph96e3qhl7fi8ftrmhccda2s4j7vmu13ntvksl3r89k3h/family1/553c74016c8648c584c5938763c7472b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/118a5e867ed0403a98ebe157adb1d9a1_SeqId_47_ 2023-02-13 04:56:11,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/de8b6eb24257475cbc11b966eaf5f356 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/de8b6eb24257475cbc11b966eaf5f356 2023-02-13 04:56:11,103 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jgtpicrrg1vbip9c0ohph96e3qhl7fi8ftrmhccda2s4j7vmu13ntvksl3r89k3h/family1/553c74016c8648c584c5938763c7472b into 5da706e80ec7bbb4fd54525c6463321f/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/118a5e867ed0403a98ebe157adb1d9a1_SeqId_47_ - updating store file list. 2023-02-13 04:56:11,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/0d632a813fee4d528b20922a24925090 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/0d632a813fee4d528b20922a24925090 2023-02-13 04:56:11,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/04fc97f97488420ab6a3a8c3d187713d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/04fc97f97488420ab6a3a8c3d187713d 2023-02-13 04:56:11,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/372a5cbe4d1c44ffb6152405142a03a3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/372a5cbe4d1c44ffb6152405142a03a3 2023-02-13 04:56:11,108 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/118a5e867ed0403a98ebe157adb1d9a1_SeqId_47_ into 5da706e80ec7bbb4fd54525c6463321f/family1 2023-02-13 04:56:11,108 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jgtpicrrg1vbip9c0ohph96e3qhl7fi8ftrmhccda2s4j7vmu13ntvksl3r89k3h/family1/553c74016c8648c584c5938763c7472b into 5da706e80ec7bbb4fd54525c6463321f/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/118a5e867ed0403a98ebe157adb1d9a1_SeqId_47_) 2023-02-13 04:56:11,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/fe0606b0be6142e686e15406ee880eb3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/fe0606b0be6142e686e15406ee880eb3 2023-02-13 04:56:11,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jgtpicrrg1vbip9c0ohph96e3qhl7fi8ftrmhccda2s4j7vmu13ntvksl3r89k3h/family1/553c74016c8648c584c5938763c7472b 2023-02-13 04:56:11,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 04:56:11,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 04:56:11,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(1912): 5da706e80ec7bbb4fd54525c6463321f/family1 is initiating minor compaction (all files) 2023-02-13 04:56:11,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@401b6c38; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:56:11,110 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 5da706e80ec7bbb4fd54525c6463321f/family1 in testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:11,110 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9f6769c618db4c75b1fc254742a6977a, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/29dfe183c7ca4b19bf958ebc68fee024, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/118a5e867ed0403a98ebe157adb1d9a1_SeqId_47_] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp, totalSize=178.1 K 2023-02-13 04:56:11,110 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 9f6769c618db4c75b1fc254742a6977a, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878843565 2023-02-13 04:56:11,111 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 29dfe183c7ca4b19bf958ebc68fee024, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621243565 2023-02-13 04:56:11,111 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] compactions.Compactor(207): Compacting 118a5e867ed0403a98ebe157adb1d9a1_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965243565 2023-02-13 04:56:11,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:56:11,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9a2691172906422683203831955b0846 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9a2691172906422683203831955b0846 2023-02-13 04:56:11,113 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:11,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/b428047052fb4e2ba6c7335c6b897da0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/b428047052fb4e2ba6c7335c6b897da0 2023-02-13 04:56:11,116 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201980c533d93de402787e8bfc6e08df258 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201980c533d93de402787e8bfc6e08df258 2023-02-13 04:56:11,116 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/56815cd11c3f47a68d5934b883681236_SeqId_44_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/56815cd11c3f47a68d5934b883681236_SeqId_44_ 2023-02-13 04:56:11,118 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120524034e4ec2fe4cdcb845ec4760e2bdfd to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120524034e4ec2fe4cdcb845ec4760e2bdfd 2023-02-13 04:56:11,119 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122898f3011e06fc42c09d9adeafa1191a87 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122898f3011e06fc42c09d9adeafa1191a87 2023-02-13 04:56:11,120 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d831df43612e432da78fe447fbe990ca to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d831df43612e432da78fe447fbe990ca 2023-02-13 04:56:11,120 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 04:56:11,121 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 04:56:11,121 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:56:11,121 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:56:11,136 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5da706e80ec7bbb4fd54525c6463321f#family1#compaction#166 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 04:56:11,571 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f5807b8ca4114547b0de3663cba3818f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f5807b8ca4114547b0de3663cba3818f 2023-02-13 04:56:11,572 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:56:11,593 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bbc4b1e09b934b46b374e2fb89b3d9b9 first=Optional[r00] last=Optional[r8] 2023-02-13 04:56:11,593 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bbc4b1e09b934b46b374e2fb89b3d9b9}] 2023-02-13 04:56:11,595 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bbc4b1e09b934b46b374e2fb89b3d9b9 for inclusion in 5da706e80ec7bbb4fd54525c6463321f/family1 2023-02-13 04:56:11,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 04:56:11,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 04:56:11,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:11,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bbc4b1e09b934b46b374e2fb89b3d9b9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__teo3ai9qctaf7q2lnq8e1i9jiqar9qd7annjpgstfm1jh2n3g6216r8im54lnde6/family1/bbc4b1e09b934b46b374e2fb89b3d9b9 2023-02-13 04:56:11,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__teo3ai9qctaf7q2lnq8e1i9jiqar9qd7annjpgstfm1jh2n3g6216r8im54lnde6/family1/bbc4b1e09b934b46b374e2fb89b3d9b9 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/43a09d54b37b4660957b37c71f2396c0_SeqId_49_ 2023-02-13 04:56:11,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__teo3ai9qctaf7q2lnq8e1i9jiqar9qd7annjpgstfm1jh2n3g6216r8im54lnde6/family1/bbc4b1e09b934b46b374e2fb89b3d9b9 into 5da706e80ec7bbb4fd54525c6463321f/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/43a09d54b37b4660957b37c71f2396c0_SeqId_49_ - updating store file list. 2023-02-13 04:56:11,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/43a09d54b37b4660957b37c71f2396c0_SeqId_49_ into 5da706e80ec7bbb4fd54525c6463321f/family1 2023-02-13 04:56:11,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__teo3ai9qctaf7q2lnq8e1i9jiqar9qd7annjpgstfm1jh2n3g6216r8im54lnde6/family1/bbc4b1e09b934b46b374e2fb89b3d9b9 into 5da706e80ec7bbb4fd54525c6463321f/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/43a09d54b37b4660957b37c71f2396c0_SeqId_49_) 2023-02-13 04:56:11,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMinorCompactionWithMonthlyPolicy__teo3ai9qctaf7q2lnq8e1i9jiqar9qd7annjpgstfm1jh2n3g6216r8im54lnde6/family1/bbc4b1e09b934b46b374e2fb89b3d9b9 2023-02-13 04:56:11,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:56:11,604 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:11,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112073cd08dea9314e70b3c4df4478c89321 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112073cd08dea9314e70b3c4df4478c89321 2023-02-13 04:56:11,606 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128aa899ae5ff664428916751ffc4647433 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128aa899ae5ff664428916751ffc4647433 2023-02-13 04:56:11,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113065eb663be7f64c5abcbf3514d74b0af9 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113065eb663be7f64c5abcbf3514d74b0af9 2023-02-13 04:56:11,607 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 04:56:11,607 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 04:56:11,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:56:11,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:56:11,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 04:56:11,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 04:56:11,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:56:11,609 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 04:56:11,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8950 sec 2023-02-13 04:56:11,721 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256 (was 249) - Thread LEAK? -, OpenFileDescriptor=643 (was 633) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=127 (was 133), ProcessCount=168 (was 168), AvailableMemoryMB=3487 (was 3523) 2023-02-13 04:56:11,732 INFO [Listener at localhost/37751] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=256, OpenFileDescriptor=643, MaxFileDescriptor=60000, SystemLoadAverage=127, ProcessCount=168, AvailableMemoryMB=3486 2023-02-13 04:56:11,751 DEBUG [Listener at localhost/37751] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-13 04:56:11,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x5Cd\xC0\xAE\x90V\x91\xC0T\xE2\xE6J\xDE\x10\x04\xBA"\x10\xAC\xF9M\xE3\xD8\xBE\xADq\xFD\xE73^GT\x08\x92*\x10\xE9\xC5\xE1F\xF5\xDDmG\xE8B\xC8\xB1\x9395T2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 04:56:11,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-13 04:56:11,805 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:56:11,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-13 04:56:11,806 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:56:11,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 04:56:11,808 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:11,808 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:11,808 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:11,808 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db empty. 2023-02-13 04:56:11,808 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b empty. 2023-02-13 04:56:11,808 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8 empty. 2023-02-13 04:56:11,809 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:11,809 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:11,809 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:11,809 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-13 04:56:11,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 04:56:12,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 04:56:12,215 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-13 04:56:12,217 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 63d8864f440c3c313b1eb8310d5cd3db, NAME => 'testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x5Cd\xC0\xAE\x90V\x91\xC0T\xE2\xE6J\xDE\x10\x04\xBA"\x10\xAC\xF9M\xE3\xD8\xBE\xADq\xFD\xE73^GT\x08\x92*\x10\xE9\xC5\xE1F\xF5\xDDmG\xE8B\xC8\xB1\x9395T2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:56:12,217 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4c9709d2533d414215f87f6eef92b74b, NAME => 'testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x5Cd\xC0\xAE\x90V\x91\xC0T\xE2\xE6J\xDE\x10\x04\xBA"\x10\xAC\xF9M\xE3\xD8\xBE\xADq\xFD\xE73^GT\x08\x92*\x10\xE9\xC5\xE1F\xF5\xDDmG\xE8B\xC8\xB1\x9395T2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:56:12,217 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6dbfce3ec623083abb6cac001ddc4fd8, NAME => 'testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x5Cd\xC0\xAE\x90V\x91\xC0T\xE2\xE6J\xDE\x10\x04\xBA"\x10\xAC\xF9M\xE3\xD8\xBE\xADq\xFD\xE73^GT\x08\x92*\x10\xE9\xC5\xE1F\xF5\xDDmG\xE8B\xC8\xB1\x9395T2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/.tmp 2023-02-13 04:56:12,370 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/.tmp/family1/ee23eb63d23a45a3b987c174bc175316 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/ee23eb63d23a45a3b987c174bc175316 2023-02-13 04:56:12,375 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5da706e80ec7bbb4fd54525c6463321f/family1 of 5da706e80ec7bbb4fd54525c6463321f into ee23eb63d23a45a3b987c174bc175316(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:56:12,375 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5da706e80ec7bbb4fd54525c6463321f: 2023-02-13 04:56:12,375 INFO [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676264171110; duration=1sec 2023-02-13 04:56:12,375 DEBUG [RS:0;jenkins-hbase4:37513-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 04:56:12,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9f6769c618db4c75b1fc254742a6977a, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/29dfe183c7ca4b19bf958ebc68fee024, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/118a5e867ed0403a98ebe157adb1d9a1_SeqId_47_] to archive 2023-02-13 04:56:12,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:12,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9f6769c618db4c75b1fc254742a6977a to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/9f6769c618db4c75b1fc254742a6977a 2023-02-13 04:56:12,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/29dfe183c7ca4b19bf958ebc68fee024 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/29dfe183c7ca4b19bf958ebc68fee024 2023-02-13 04:56:12,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/118a5e867ed0403a98ebe157adb1d9a1_SeqId_47_ to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/family1/118a5e867ed0403a98ebe157adb1d9a1_SeqId_47_ 2023-02-13 04:56:12,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 04:56:12,622 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 63d8864f440c3c313b1eb8310d5cd3db, disabling compactions & flushes 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 4c9709d2533d414215f87f6eef92b74b, disabling compactions & flushes 2023-02-13 04:56:12,623 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 6dbfce3ec623083abb6cac001ddc4fd8, disabling compactions & flushes 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. after waiting 0 ms 2023-02-13 04:56:12,623 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:12,623 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:12,623 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 63d8864f440c3c313b1eb8310d5cd3db: Waiting for close lock at 1676264172623Disabling compacts and flushes for region at 1676264172623Disabling writes for close at 1676264172623Writing region close event to WAL at 1676264172623Closed at 1676264172623 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. after waiting 0 ms 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. after waiting 0 ms 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:12,623 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:12,624 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:12,624 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:12,624 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 4c9709d2533d414215f87f6eef92b74b: Waiting for close lock at 1676264172623Disabling compacts and flushes for region at 1676264172623Disabling writes for close at 1676264172623Writing region close event to WAL at 1676264172624 (+1 ms)Closed at 1676264172624 2023-02-13 04:56:12,624 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 6dbfce3ec623083abb6cac001ddc4fd8: Waiting for close lock at 1676264172623Disabling compacts and flushes for region at 1676264172623Disabling writes for close at 1676264172623Writing region close event to WAL at 1676264172624 (+1 ms)Closed at 1676264172624 2023-02-13 04:56:12,626 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:56:12,627 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264172627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264172627"}]},"ts":"1676264172627"} 2023-02-13 04:56:12,627 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676264172627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264172627"}]},"ts":"1676264172627"} 2023-02-13 04:56:12,627 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264172627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676264172627"}]},"ts":"1676264172627"} 2023-02-13 04:56:12,628 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 04:56:12,629 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:56:12,629 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264172629"}]},"ts":"1676264172629"} 2023-02-13 04:56:12,630 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-13 04:56:12,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=63d8864f440c3c313b1eb8310d5cd3db, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4c9709d2533d414215f87f6eef92b74b, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6dbfce3ec623083abb6cac001ddc4fd8, ASSIGN}] 2023-02-13 04:56:12,634 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=63d8864f440c3c313b1eb8310d5cd3db, ASSIGN 2023-02-13 04:56:12,634 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6dbfce3ec623083abb6cac001ddc4fd8, ASSIGN 2023-02-13 04:56:12,634 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4c9709d2533d414215f87f6eef92b74b, ASSIGN 2023-02-13 04:56:12,634 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6dbfce3ec623083abb6cac001ddc4fd8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:56:12,634 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=63d8864f440c3c313b1eb8310d5cd3db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:56:12,634 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4c9709d2533d414215f87f6eef92b74b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37513,1676264019660; forceNewPlan=false, retain=false 2023-02-13 04:56:12,786 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=63d8864f440c3c313b1eb8310d5cd3db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:12,786 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=6dbfce3ec623083abb6cac001ddc4fd8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:12,786 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264172786"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264172786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264172786"}]},"ts":"1676264172786"} 2023-02-13 04:56:12,786 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=4c9709d2533d414215f87f6eef92b74b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:12,786 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264172786"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264172786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264172786"}]},"ts":"1676264172786"} 2023-02-13 04:56:12,786 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676264172786"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676264172786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676264172786"}]},"ts":"1676264172786"} 2023-02-13 04:56:12,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 63d8864f440c3c313b1eb8310d5cd3db, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:56:12,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 6dbfce3ec623083abb6cac001ddc4fd8, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:56:12,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 4c9709d2533d414215f87f6eef92b74b, server=jenkins-hbase4.apache.org,37513,1676264019660}] 2023-02-13 04:56:12,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 04:56:12,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:12,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4c9709d2533d414215f87f6eef92b74b, NAME => 'testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 04:56:12,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:12,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:56:12,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:12,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:12,964 INFO [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:12,965 DEBUG [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1 2023-02-13 04:56:12,965 DEBUG [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1 2023-02-13 04:56:12,966 INFO [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c9709d2533d414215f87f6eef92b74b columnFamilyName family1 2023-02-13 04:56:12,967 INFO [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] regionserver.HStore(310): Store=4c9709d2533d414215f87f6eef92b74b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:56:12,967 INFO [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:12,968 DEBUG [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2 2023-02-13 04:56:12,968 DEBUG [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2 2023-02-13 04:56:12,968 INFO [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c9709d2533d414215f87f6eef92b74b columnFamilyName family2 2023-02-13 04:56:12,970 INFO [StoreOpener-4c9709d2533d414215f87f6eef92b74b-1] regionserver.HStore(310): Store=4c9709d2533d414215f87f6eef92b74b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:56:12,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:12,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:12,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:56:12,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:12,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:56:12,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4c9709d2533d414215f87f6eef92b74b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63918905, jitterRate=-0.047534093260765076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:56:12,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4c9709d2533d414215f87f6eef92b74b: Running coprocessor pre-open hook at 1676264172943Writing region info on filesystem at 1676264172943Initializing all the Stores at 1676264172943Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x5Cd\xC0\xAE\x90V\x91\xC0T\xE2\xE6J\xDE\x10\x04\xBA"\x10\xAC\xF9M\xE3\xD8\xBE\xADq\xFD\xE73^GT\x08\x92*\x10\xE9\xC5\xE1F\xF5\xDDmG\xE8B\xC8\xB1\x9395T2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264172943Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264172943Cleaning up temporary data from old regions at 1676264172971 (+28 ms)Cleaning up detritus from prior splits at 1676264172972 (+1 ms)Running coprocessor post-open hooks at 1676264172975 (+3 ms)Region opened successfully at 1676264172975 2023-02-13 04:56:12,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b., pid=122, masterSystemTime=1676264172939 2023-02-13 04:56:12,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:12,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:12,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:12,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 63d8864f440c3c313b1eb8310d5cd3db, NAME => 'testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 04:56:12,977 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=4c9709d2533d414215f87f6eef92b74b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:12,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:12,977 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676264172977"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264172977"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264172977"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264172977"}]},"ts":"1676264172977"} 2023-02-13 04:56:12,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:56:12,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:12,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:12,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-02-13 04:56:12,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 4c9709d2533d414215f87f6eef92b74b, server=jenkins-hbase4.apache.org,37513,1676264019660 in 189 msec 2023-02-13 04:56:12,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4c9709d2533d414215f87f6eef92b74b, ASSIGN in 348 msec 2023-02-13 04:56:12,998 INFO [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:12,999 DEBUG [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1 2023-02-13 04:56:12,999 DEBUG [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1 2023-02-13 04:56:12,999 INFO [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63d8864f440c3c313b1eb8310d5cd3db columnFamilyName family1 2023-02-13 04:56:13,000 INFO [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] regionserver.HStore(310): Store=63d8864f440c3c313b1eb8310d5cd3db/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:56:13,000 INFO [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:13,001 DEBUG [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2 2023-02-13 04:56:13,001 DEBUG [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2 2023-02-13 04:56:13,001 INFO [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63d8864f440c3c313b1eb8310d5cd3db columnFamilyName family2 2023-02-13 04:56:13,002 INFO [StoreOpener-63d8864f440c3c313b1eb8310d5cd3db-1] regionserver.HStore(310): Store=63d8864f440c3c313b1eb8310d5cd3db/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:56:13,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:13,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:13,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:56:13,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:13,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:56:13,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 63d8864f440c3c313b1eb8310d5cd3db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73079342, jitterRate=0.08896705508232117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:56:13,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 63d8864f440c3c313b1eb8310d5cd3db: Running coprocessor pre-open hook at 1676264172978Writing region info on filesystem at 1676264172978Initializing all the Stores at 1676264172978Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x5Cd\xC0\xAE\x90V\x91\xC0T\xE2\xE6J\xDE\x10\x04\xBA"\x10\xAC\xF9M\xE3\xD8\xBE\xADq\xFD\xE73^GT\x08\x92*\x10\xE9\xC5\xE1F\xF5\xDDmG\xE8B\xC8\xB1\x9395T2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264172978Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264172978Cleaning up temporary data from old regions at 1676264173003 (+25 ms)Cleaning up detritus from prior splits at 1676264173003Running coprocessor post-open hooks at 1676264173006 (+3 ms)Region opened successfully at 1676264173006 2023-02-13 04:56:13,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db., pid=120, masterSystemTime=1676264172939 2023-02-13 04:56:13,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:13,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:13,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:13,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6dbfce3ec623083abb6cac001ddc4fd8, NAME => 'testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 04:56:13,008 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=63d8864f440c3c313b1eb8310d5cd3db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:13,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:13,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:56:13,008 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264173008"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264173008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264173008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264173008"}]},"ts":"1676264173008"} 2023-02-13 04:56:13,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:13,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:13,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-02-13 04:56:13,010 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 63d8864f440c3c313b1eb8310d5cd3db, server=jenkins-hbase4.apache.org,37513,1676264019660 in 221 msec 2023-02-13 04:56:13,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=63d8864f440c3c313b1eb8310d5cd3db, ASSIGN in 378 msec 2023-02-13 04:56:13,032 INFO [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:13,033 DEBUG [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1 2023-02-13 04:56:13,033 DEBUG [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1 2023-02-13 04:56:13,033 INFO [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dbfce3ec623083abb6cac001ddc4fd8 columnFamilyName family1 2023-02-13 04:56:13,034 INFO [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] regionserver.HStore(310): Store=6dbfce3ec623083abb6cac001ddc4fd8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:56:13,034 INFO [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:13,035 DEBUG [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2 2023-02-13 04:56:13,035 DEBUG [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2 2023-02-13 04:56:13,035 INFO [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dbfce3ec623083abb6cac001ddc4fd8 columnFamilyName family2 2023-02-13 04:56:13,036 INFO [StoreOpener-6dbfce3ec623083abb6cac001ddc4fd8-1] regionserver.HStore(310): Store=6dbfce3ec623083abb6cac001ddc4fd8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:56:13,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:13,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:13,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:56:13,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:13,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:56:13,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6dbfce3ec623083abb6cac001ddc4fd8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67394553, jitterRate=0.004257097840309143}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:56:13,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6dbfce3ec623083abb6cac001ddc4fd8: Running coprocessor pre-open hook at 1676264173008Writing region info on filesystem at 1676264173008Initializing all the Stores at 1676264173009 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x5Cd\xC0\xAE\x90V\x91\xC0T\xE2\xE6J\xDE\x10\x04\xBA"\x10\xAC\xF9M\xE3\xD8\xBE\xADq\xFD\xE73^GT\x08\x92*\x10\xE9\xC5\xE1F\xF5\xDDmG\xE8B\xC8\xB1\x9395T2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264173009Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676264173009Cleaning up temporary data from old regions at 1676264173037 (+28 ms)Cleaning up detritus from prior splits at 1676264173037Running coprocessor post-open hooks at 1676264173040 (+3 ms)Region opened successfully at 1676264173040 2023-02-13 04:56:13,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8., pid=121, masterSystemTime=1676264172939 2023-02-13 04:56:13,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:13,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:13,042 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=6dbfce3ec623083abb6cac001ddc4fd8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:13,042 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676264173042"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676264173042"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676264173042"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676264173042"}]},"ts":"1676264173042"} 2023-02-13 04:56:13,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-02-13 04:56:13,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 6dbfce3ec623083abb6cac001ddc4fd8, server=jenkins-hbase4.apache.org,37513,1676264019660 in 255 msec 2023-02-13 04:56:13,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-02-13 04:56:13,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6dbfce3ec623083abb6cac001ddc4fd8, ASSIGN in 413 msec 2023-02-13 04:56:13,046 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:56:13,046 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676264173046"}]},"ts":"1676264173046"} 2023-02-13 04:56:13,047 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-13 04:56:13,049 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:56:13,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2460 sec 2023-02-13 04:56:13,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 04:56:13,911 INFO [Listener at localhost/37751] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-13 04:56:13,916 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:13,917 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:13,917 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:13,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:13,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 04:56:13,924 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 04:56:13,924 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:13,924 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 04:56:13,924 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 04:56:13,924 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:13,924 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:13,930 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:13,930 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:13,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:13,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:13,930 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:13,930 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:13,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:13,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:13,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:13,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:13,931 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 04:56:13,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 04:56:13,931 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 04:56:13,931 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:13,931 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 04:56:13,931 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:13,931 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:56:13,931 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:13,931 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:13,931 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. started... 2023-02-13 04:56:13,932 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. started... 2023-02-13 04:56:13,931 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:13,931 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. started... 2023-02-13 04:56:13,932 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6dbfce3ec623083abb6cac001ddc4fd8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 04:56:13,934 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4c9709d2533d414215f87f6eef92b74b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 04:56:13,934 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 63d8864f440c3c313b1eb8310d5cd3db 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 04:56:13,974 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021339af4ec3a22c4d7fb8f0f771d60d4954 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021339af4ec3a22c4d7fb8f0f771d60d4954 2023-02-13 04:56:14,388 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213f951d2106a06497391bad24611e5dca5 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213f951d2106a06497391bad24611e5dca5 2023-02-13 04:56:14,388 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302139276bf681bd64e84acb8e82a426fef86 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139276bf681bd64e84acb8e82a426fef86 2023-02-13 04:56:14,400 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/129f279aebf74ed8a3619fd415fc624f 2023-02-13 04:56:14,439 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213203a72e5c3d84d6c950465ce8fe525f4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213203a72e5c3d84d6c950465ce8fe525f4 2023-02-13 04:56:14,443 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/0e14a5cab9854b289d75ab0ad22f4e91 2023-02-13 04:56:14,447 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/129f279aebf74ed8a3619fd415fc624f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/129f279aebf74ed8a3619fd415fc624f 2023-02-13 04:56:14,472 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/129f279aebf74ed8a3619fd415fc624f, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 04:56:14,472 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/0e14a5cab9854b289d75ab0ad22f4e91 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/0e14a5cab9854b289d75ab0ad22f4e91 2023-02-13 04:56:14,475 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/0e14a5cab9854b289d75ab0ad22f4e91, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 04:56:14,476 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4c9709d2533d414215f87f6eef92b74b in 542ms, sequenceid=5, compaction requested=false 2023-02-13 04:56:14,476 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-13 04:56:14,476 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4c9709d2533d414215f87f6eef92b74b: 2023-02-13 04:56:14,476 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:14,476 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:56:14,805 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/67b95c40914a459f8ba7dce06adf3ef8 2023-02-13 04:56:14,810 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/06a2beb670a643eaa261fd6b6e903aee 2023-02-13 04:56:15,240 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213c96213a5f51a4761a859ae86701dadfd to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213c96213a5f51a4761a859ae86701dadfd 2023-02-13 04:56:15,241 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213391bd8d2e22d4a798d96f9df5850d80b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213391bd8d2e22d4a798d96f9df5850d80b 2023-02-13 04:56:15,646 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/5189c855a9474f93afc71b9b1dd59eb1 2023-02-13 04:56:15,647 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/b9fef430f99b4bdab01d5771da4c552c 2023-02-13 04:56:15,650 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/67b95c40914a459f8ba7dce06adf3ef8 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/67b95c40914a459f8ba7dce06adf3ef8 2023-02-13 04:56:15,651 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/06a2beb670a643eaa261fd6b6e903aee as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/06a2beb670a643eaa261fd6b6e903aee 2023-02-13 04:56:15,674 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/06a2beb670a643eaa261fd6b6e903aee, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 04:56:15,675 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/b9fef430f99b4bdab01d5771da4c552c as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/b9fef430f99b4bdab01d5771da4c552c 2023-02-13 04:56:15,678 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/b9fef430f99b4bdab01d5771da4c552c, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 04:56:15,679 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 63d8864f440c3c313b1eb8310d5cd3db in 1745ms, sequenceid=5, compaction requested=false 2023-02-13 04:56:15,679 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 63d8864f440c3c313b1eb8310d5cd3db: 2023-02-13 04:56:15,679 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:15,680 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:56:15,683 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/67b95c40914a459f8ba7dce06adf3ef8, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 04:56:15,683 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/5189c855a9474f93afc71b9b1dd59eb1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/5189c855a9474f93afc71b9b1dd59eb1 2023-02-13 04:56:15,686 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/5189c855a9474f93afc71b9b1dd59eb1, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 04:56:15,687 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6dbfce3ec623083abb6cac001ddc4fd8 in 1755ms, sequenceid=5, compaction requested=false 2023-02-13 04:56:15,687 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6dbfce3ec623083abb6cac001ddc4fd8: 2023-02-13 04:56:15,687 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:15,687 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:56:15,687 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:56:15,687 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,687 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 04:56:15,687 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 04:56:15,689 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,689 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:15,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:15,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:15,689 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:15,689 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:15,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:15,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:15,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:15,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:15,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 04:56:15,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1646c34c[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:15,690 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 04:56:15,691 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:15,692 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:15,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:15,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:15,692 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 04:56:15,692 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 04:56:15,692 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:15,692 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,692 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:15,693 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 04:56:15,693 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:15,693 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,693 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 04:56:15,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:15,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:15,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:15,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:15,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:15,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:15,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:15,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:15,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 04:56:15,695 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 04:56:15,695 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:15,695 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:15,696 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 04:56:15,696 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:15,698 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:15,698 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:15,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:15,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:15,699 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:15,699 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:15,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:15,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,700 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:15,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:15,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,702 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:15,702 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,702 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:15,703 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:15,703 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:15,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:15,703 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:15,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 04:56:15,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:15,703 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:15,703 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:15,703 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:15,703 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:15,703 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:15,703 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:15,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:15,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:15,803 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:15,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:15,805 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:15,805 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:15,805 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:15,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:15,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:15,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 04:56:15,808 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 04:56:15,809 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:15,809 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 04:56:15,809 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 04:56:15,809 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:15,809 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:15,810 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,810 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:15,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:15,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:15,810 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:15,810 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:15,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:15,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:15,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:15,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:15,811 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 04:56:15,811 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 04:56:15,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 04:56:15,812 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 04:56:15,812 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:15,812 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 04:56:15,812 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:15,812 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:56:15,812 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:15,812 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:15,812 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:15,812 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. started... 2023-02-13 04:56:15,812 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. started... 2023-02-13 04:56:15,812 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. started... 2023-02-13 04:56:15,812 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4c9709d2533d414215f87f6eef92b74b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 04:56:15,812 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 63d8864f440c3c313b1eb8310d5cd3db 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 04:56:15,812 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6dbfce3ec623083abb6cac001ddc4fd8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 04:56:15,854 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021352f8059a5f5e4814b5603fce121af87f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021352f8059a5f5e4814b5603fce121af87f 2023-02-13 04:56:16,257 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302139cc9231424ff4497a6ace9423ac728cb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139cc9231424ff4497a6ace9423ac728cb 2023-02-13 04:56:16,257 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021337b0c737c5c94ab3bb6db4d2910e0ad6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021337b0c737c5c94ab3bb6db4d2910e0ad6 2023-02-13 04:56:16,268 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/f89362636d8e46878bb2135029524a35 2023-02-13 04:56:16,686 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/e55b05898fb44df793569c3bc23140ce 2023-02-13 04:56:16,694 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/0fbeffe9b98141eba39c8dea6dfb3833 2023-02-13 04:56:16,727 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021317a273be8fd545998c06e96a3b78985b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021317a273be8fd545998c06e96a3b78985b 2023-02-13 04:56:16,729 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213696855aae03f4bbfb431f39850613a8b to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213696855aae03f4bbfb431f39850613a8b 2023-02-13 04:56:16,748 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/591814751c7b47b3a6e67964e0966837 2023-02-13 04:56:16,750 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/275e6e0d8ed34740ae3ebf33d72a4452 2023-02-13 04:56:16,754 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/f89362636d8e46878bb2135029524a35 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/f89362636d8e46878bb2135029524a35 2023-02-13 04:56:16,754 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/0fbeffe9b98141eba39c8dea6dfb3833 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/0fbeffe9b98141eba39c8dea6dfb3833 2023-02-13 04:56:16,780 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/f89362636d8e46878bb2135029524a35, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 04:56:16,781 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/591814751c7b47b3a6e67964e0966837 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/591814751c7b47b3a6e67964e0966837 2023-02-13 04:56:16,781 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/0fbeffe9b98141eba39c8dea6dfb3833, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 04:56:16,782 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/275e6e0d8ed34740ae3ebf33d72a4452 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/275e6e0d8ed34740ae3ebf33d72a4452 2023-02-13 04:56:16,785 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/591814751c7b47b3a6e67964e0966837, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 04:56:16,785 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/275e6e0d8ed34740ae3ebf33d72a4452, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 04:56:16,786 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4c9709d2533d414215f87f6eef92b74b in 974ms, sequenceid=9, compaction requested=false 2023-02-13 04:56:16,786 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 63d8864f440c3c313b1eb8310d5cd3db in 974ms, sequenceid=9, compaction requested=false 2023-02-13 04:56:16,786 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4c9709d2533d414215f87f6eef92b74b: 2023-02-13 04:56:16,786 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 63d8864f440c3c313b1eb8310d5cd3db: 2023-02-13 04:56:16,786 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:16,786 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:16,786 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:56:16,786 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:56:17,124 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a2c1554fa81a4beb87c326cdacfa9562 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213a2c1554fa81a4beb87c326cdacfa9562 2023-02-13 04:56:17,529 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/736fb9f413954ad3957396f1715cb8cc 2023-02-13 04:56:17,532 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/e55b05898fb44df793569c3bc23140ce as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/e55b05898fb44df793569c3bc23140ce 2023-02-13 04:56:17,556 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/e55b05898fb44df793569c3bc23140ce, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 04:56:17,556 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/736fb9f413954ad3957396f1715cb8cc as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/736fb9f413954ad3957396f1715cb8cc 2023-02-13 04:56:17,560 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/736fb9f413954ad3957396f1715cb8cc, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 04:56:17,560 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6dbfce3ec623083abb6cac001ddc4fd8 in 1748ms, sequenceid=9, compaction requested=false 2023-02-13 04:56:17,560 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6dbfce3ec623083abb6cac001ddc4fd8: 2023-02-13 04:56:17,560 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:17,560 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:56:17,560 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:56:17,560 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 04:56:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 04:56:17,562 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,562 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:17,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:17,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:17,562 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:17,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:17,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:17,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:17,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:17,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 04:56:17,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@130f7859[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:17,564 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 04:56:17,564 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:17,565 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:17,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:17,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:17,566 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 04:56:17,566 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 04:56:17,566 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:17,566 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,566 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:17,567 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 04:56:17,567 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,567 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:17,567 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 04:56:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:17,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 04:56:17,569 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 04:56:17,569 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:17,569 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:17,569 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 04:56:17,569 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:17,570 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:17,570 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:17,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:17,570 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:17,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:17,571 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,572 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,574 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,574 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:17,574 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:17,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:17,574 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:17,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 04:56:17,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:17,574 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:17,574 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:17,574 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,574 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:17,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:17,575 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:17,574 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:17,575 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:17,575 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:17,675 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:17,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:17,676 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:17,677 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:17,677 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:17,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:17,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:17,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 04:56:17,680 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 04:56:17,680 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:17,681 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 04:56:17,681 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 04:56:17,681 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:17,681 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:17,683 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:17,683 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:17,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:17,684 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:17,684 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:17,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:17,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:17,684 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 04:56:17,685 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 04:56:17,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 04:56:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 04:56:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 04:56:17,685 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:17,685 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:17,685 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:17,685 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. started... 2023-02-13 04:56:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:56:17,685 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:17,685 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. started... 2023-02-13 04:56:17,685 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 63d8864f440c3c313b1eb8310d5cd3db 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 04:56:17,685 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. started... 2023-02-13 04:56:17,685 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6dbfce3ec623083abb6cac001ddc4fd8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 04:56:17,685 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4c9709d2533d414215f87f6eef92b74b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 04:56:17,739 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213be49a3d0ef8e43a1a4d6373fa919528f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213be49a3d0ef8e43a1a4d6373fa919528f 2023-02-13 04:56:18,127 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213f8aeebf2acc944e09f2a30fdf0e64abf to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213f8aeebf2acc944e09f2a30fdf0e64abf 2023-02-13 04:56:18,127 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021396b915b9b2f541bda883c8cba014f230 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021396b915b9b2f541bda883c8cba014f230 2023-02-13 04:56:18,148 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/cbb6de070390453e8a6d905d90971c42 2023-02-13 04:56:18,153 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/ec3830e930774e39afcf540e8f8a7985 2023-02-13 04:56:18,181 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:56:18,181 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0697bed6 to 127.0.0.1:54862 2023-02-13 04:56:18,181 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:56:18,181 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:56:18,181 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48ee0a65 to 127.0.0.1:54862 2023-02-13 04:56:18,181 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:56:18,480 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:56:18,542 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/d54fdc0d452a44e0842e22403d59c588 2023-02-13 04:56:18,597 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021361ecea5c4da1450fb7e912e17ffa71dc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023021361ecea5c4da1450fb7e912e17ffa71dc 2023-02-13 04:56:18,602 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/727d9841937e4c5584511d85c2f5ec4c 2023-02-13 04:56:18,605 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/cbb6de070390453e8a6d905d90971c42 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/cbb6de070390453e8a6d905d90971c42 2023-02-13 04:56:18,613 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213064c06c835c84fa68e76105982ec64fb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213064c06c835c84fa68e76105982ec64fb 2023-02-13 04:56:18,639 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/cbb6de070390453e8a6d905d90971c42, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 04:56:18,639 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/727d9841937e4c5584511d85c2f5ec4c as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/727d9841937e4c5584511d85c2f5ec4c 2023-02-13 04:56:18,642 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/727d9841937e4c5584511d85c2f5ec4c, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 04:56:18,643 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 63d8864f440c3c313b1eb8310d5cd3db in 958ms, sequenceid=13, compaction requested=true 2023-02-13 04:56:18,643 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 63d8864f440c3c313b1eb8310d5cd3db: 2023-02-13 04:56:18,643 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:18,643 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:56:18,978 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213d1ab2e2c3a2346d4826788b4e0458267 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213d1ab2e2c3a2346d4826788b4e0458267 2023-02-13 04:56:19,019 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/c7b3fd8602f649449fdbf369d075b1ae 2023-02-13 04:56:19,022 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/ec3830e930774e39afcf540e8f8a7985 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/ec3830e930774e39afcf540e8f8a7985 2023-02-13 04:56:19,046 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/ec3830e930774e39afcf540e8f8a7985, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 04:56:19,047 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/c7b3fd8602f649449fdbf369d075b1ae as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c7b3fd8602f649449fdbf369d075b1ae 2023-02-13 04:56:19,050 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c7b3fd8602f649449fdbf369d075b1ae, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 04:56:19,051 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4c9709d2533d414215f87f6eef92b74b in 1366ms, sequenceid=13, compaction requested=true 2023-02-13 04:56:19,051 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4c9709d2533d414215f87f6eef92b74b: 2023-02-13 04:56:19,051 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:19,051 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:56:19,382 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/7476386f904a417faebc2b42d2b9c804 2023-02-13 04:56:19,386 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/d54fdc0d452a44e0842e22403d59c588 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/d54fdc0d452a44e0842e22403d59c588 2023-02-13 04:56:19,409 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/d54fdc0d452a44e0842e22403d59c588, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 04:56:19,409 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/7476386f904a417faebc2b42d2b9c804 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/7476386f904a417faebc2b42d2b9c804 2023-02-13 04:56:19,412 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/7476386f904a417faebc2b42d2b9c804, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 04:56:19,413 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6dbfce3ec623083abb6cac001ddc4fd8 in 1728ms, sequenceid=13, compaction requested=true 2023-02-13 04:56:19,413 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6dbfce3ec623083abb6cac001ddc4fd8: 2023-02-13 04:56:19,413 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:19,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:56:19,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:56:19,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 04:56:19,413 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 04:56:19,415 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,415 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:19,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:19,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:19,415 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:19,415 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:19,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:19,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:19,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:19,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:19,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 04:56:19,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2581fb27[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:19,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 04:56:19,416 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:19,418 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:19,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:19,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:19,418 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 04:56:19,418 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 04:56:19,418 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:19,418 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,418 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:19,420 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:19,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:19,420 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 04:56:19,420 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:19,420 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 04:56:19,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:19,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 04:56:19,422 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 04:56:19,422 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:19,422 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:19,422 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 04:56:19,422 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:19,423 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:19,423 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:19,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:19,423 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:19,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:19,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:19,424 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:19,425 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,435 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,435 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:19,435 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:19,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 04:56:19,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 04:56:19,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:19,435 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:19,435 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:19,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:19,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:19,435 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:19,435 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:19,435 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,435 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:19,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:19,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:19,435 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:19,436 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:19,436 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:19,536 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:19,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:19,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:19,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:19,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 04:56:19,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:19,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:19,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 04:56:19,541 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 04:56:19,541 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:19,541 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 04:56:19,541 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 04:56:19,541 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:19,541 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:19,543 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,543 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:19,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:19,544 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:19,544 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:19,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:19,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:19,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 04:56:19,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 04:56:19,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 04:56:19,545 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 04:56:19,545 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:19,545 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 04:56:19,545 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:19,545 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:56:19,545 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:19,545 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:19,545 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:19,545 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. started... 2023-02-13 04:56:19,545 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. started... 2023-02-13 04:56:19,545 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. started... 2023-02-13 04:56:19,545 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 63d8864f440c3c313b1eb8310d5cd3db 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 04:56:19,545 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6dbfce3ec623083abb6cac001ddc4fd8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 04:56:19,545 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4c9709d2533d414215f87f6eef92b74b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 04:56:19,601 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021353d463d1b6ea4d83ab05a7cabd675661 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021353d463d1b6ea4d83ab05a7cabd675661 2023-02-13 04:56:19,603 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213c121e82d741a414e8c656d0005fba462 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213c121e82d741a414e8c656d0005fba462 2023-02-13 04:56:19,608 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302139ab3038e028b4baa8231b1d8d439f77c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302139ab3038e028b4baa8231b1d8d439f77c 2023-02-13 04:56:19,617 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/6fbdeebdef5342e1838ec437e9b080d7 2023-02-13 04:56:20,019 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/a97a29d372af4b9a9763afcdb4eaafee 2023-02-13 04:56:20,023 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/19b04e0825b842cbbf826cb99f3b2338 2023-02-13 04:56:20,047 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302139ea3f17b79774b3c83d0a5e69eda6169 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302139ea3f17b79774b3c83d0a5e69eda6169 2023-02-13 04:56:20,064 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/c3b3ccc896c644fe90fa947aa90d0397 2023-02-13 04:56:20,080 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/6fbdeebdef5342e1838ec437e9b080d7 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/6fbdeebdef5342e1838ec437e9b080d7 2023-02-13 04:56:20,083 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a26b3f1fde144f529b398649d243779f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213a26b3f1fde144f529b398649d243779f 2023-02-13 04:56:20,109 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/6fbdeebdef5342e1838ec437e9b080d7, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 04:56:20,110 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/c3b3ccc896c644fe90fa947aa90d0397 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c3b3ccc896c644fe90fa947aa90d0397 2023-02-13 04:56:20,114 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c3b3ccc896c644fe90fa947aa90d0397, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 04:56:20,114 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4c9709d2533d414215f87f6eef92b74b in 569ms, sequenceid=17, compaction requested=true 2023-02-13 04:56:20,114 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4c9709d2533d414215f87f6eef92b74b: 2023-02-13 04:56:20,115 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:20,115 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:56:20,481 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213fda5453e3cef4adcb92a924c3ae2cda0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213fda5453e3cef4adcb92a924c3ae2cda0 2023-02-13 04:56:20,495 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/607a69a1e71d4dd295481c194d549a7d 2023-02-13 04:56:20,499 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/19b04e0825b842cbbf826cb99f3b2338 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/19b04e0825b842cbbf826cb99f3b2338 2023-02-13 04:56:20,523 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/19b04e0825b842cbbf826cb99f3b2338, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 04:56:20,523 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/607a69a1e71d4dd295481c194d549a7d as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/607a69a1e71d4dd295481c194d549a7d 2023-02-13 04:56:20,527 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/607a69a1e71d4dd295481c194d549a7d, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 04:56:20,527 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 63d8864f440c3c313b1eb8310d5cd3db in 982ms, sequenceid=17, compaction requested=true 2023-02-13 04:56:20,527 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 63d8864f440c3c313b1eb8310d5cd3db: 2023-02-13 04:56:20,527 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:20,527 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:56:20,886 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/f655143e760e43748560281490dd5871 2023-02-13 04:56:20,890 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/a97a29d372af4b9a9763afcdb4eaafee as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/a97a29d372af4b9a9763afcdb4eaafee 2023-02-13 04:56:20,913 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/a97a29d372af4b9a9763afcdb4eaafee, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 04:56:20,914 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/f655143e760e43748560281490dd5871 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/f655143e760e43748560281490dd5871 2023-02-13 04:56:20,918 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/f655143e760e43748560281490dd5871, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 04:56:20,918 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6dbfce3ec623083abb6cac001ddc4fd8 in 1373ms, sequenceid=17, compaction requested=true 2023-02-13 04:56:20,918 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6dbfce3ec623083abb6cac001ddc4fd8: 2023-02-13 04:56:20,918 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:20,919 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:56:20,919 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:56:20,919 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,919 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 04:56:20,919 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 04:56:20,920 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,920 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:20,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:20,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:20,921 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:20,921 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:20,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:20,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 04:56:20,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a4f591[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:20,922 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 04:56:20,922 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:20,923 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:20,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:20,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:20,924 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 04:56:20,924 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 04:56:20,924 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,924 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:20,924 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:20,925 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 04:56:20,925 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,925 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:20,925 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 04:56:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:20,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:20,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:20,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 04:56:20,927 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 04:56:20,927 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:20,927 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:20,927 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 04:56:20,928 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:20,930 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:20,930 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:20,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:20,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:20,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:20,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:20,930 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:20,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:20,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:20,930 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:20,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:20,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:20,933 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,935 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:20,935 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,935 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:20,935 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:20,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 04:56:20,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:20,935 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:20,935 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:20,935 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:20,935 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:20,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:20,935 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:20,935 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:20,936 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:20,936 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:20,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:21,036 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:21,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:21,045 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:56:21,051 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:56:21,061 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:56:21,062 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:56:21,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:56:21,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 04:56:21,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 04:56:21,152 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 04:56:21,152 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:21,152 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 04:56:21,152 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 04:56:21,152 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:21,152 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:21,154 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:21,154 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:21,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:21,154 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:21,154 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:56:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:21,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:56:21,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:21,155 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 04:56:21,156 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 04:56:21,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 04:56:21,156 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 04:56:21,156 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:56:21,156 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 04:56:21,156 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:21,156 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. started... 2023-02-13 04:56:21,156 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4c9709d2533d414215f87f6eef92b74b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 04:56:21,160 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:21,160 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. started... 2023-02-13 04:56:21,160 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 04:56:21,160 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:21,160 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. started... 2023-02-13 04:56:21,160 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:56:21,160 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6dbfce3ec623083abb6cac001ddc4fd8 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 04:56:21,160 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 63d8864f440c3c313b1eb8310d5cd3db 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 04:56:21,193 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/7ca7851209ba4e9590f1c0cd6f7f5688 2023-02-13 04:56:21,215 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ca7851209ba4e9590f1c0cd6f7f5688 2023-02-13 04:56:22,014 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/e2bd709aed4946dabb2b4642efb14ef0 2023-02-13 04:56:22,014 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/7008e3cbfe9e40599637cb6d88fd87f4 2023-02-13 04:56:22,025 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/967bcc0819354702a36edb0dd54c1e31 2023-02-13 04:56:22,028 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 967bcc0819354702a36edb0dd54c1e31 2023-02-13 04:56:22,028 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/7ca7851209ba4e9590f1c0cd6f7f5688 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/7ca7851209ba4e9590f1c0cd6f7f5688 2023-02-13 04:56:22,057 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7008e3cbfe9e40599637cb6d88fd87f4 2023-02-13 04:56:22,057 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2bd709aed4946dabb2b4642efb14ef0 2023-02-13 04:56:22,059 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ca7851209ba4e9590f1c0cd6f7f5688 2023-02-13 04:56:22,060 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/7ca7851209ba4e9590f1c0cd6f7f5688, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 04:56:22,060 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/967bcc0819354702a36edb0dd54c1e31 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/967bcc0819354702a36edb0dd54c1e31 2023-02-13 04:56:22,065 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 967bcc0819354702a36edb0dd54c1e31 2023-02-13 04:56:22,065 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/967bcc0819354702a36edb0dd54c1e31, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 04:56:22,066 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6dbfce3ec623083abb6cac001ddc4fd8 in 906ms, sequenceid=23, compaction requested=true 2023-02-13 04:56:22,066 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6dbfce3ec623083abb6cac001ddc4fd8: 2023-02-13 04:56:22,066 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:22,066 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 04:56:22,501 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/013cc1be2360477fa6f5ca9257af6a58 2023-02-13 04:56:22,504 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 013cc1be2360477fa6f5ca9257af6a58 2023-02-13 04:56:22,505 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/e2bd709aed4946dabb2b4642efb14ef0 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/e2bd709aed4946dabb2b4642efb14ef0 2023-02-13 04:56:22,528 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e2bd709aed4946dabb2b4642efb14ef0 2023-02-13 04:56:22,529 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/e2bd709aed4946dabb2b4642efb14ef0, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 04:56:22,529 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/013cc1be2360477fa6f5ca9257af6a58 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/013cc1be2360477fa6f5ca9257af6a58 2023-02-13 04:56:22,533 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 013cc1be2360477fa6f5ca9257af6a58 2023-02-13 04:56:22,533 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/013cc1be2360477fa6f5ca9257af6a58, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 04:56:22,534 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4c9709d2533d414215f87f6eef92b74b in 1378ms, sequenceid=23, compaction requested=true 2023-02-13 04:56:22,534 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4c9709d2533d414215f87f6eef92b74b: 2023-02-13 04:56:22,534 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:22,534 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 04:56:22,896 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/473143a529674a058379a57237abd838 2023-02-13 04:56:22,899 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 473143a529674a058379a57237abd838 2023-02-13 04:56:22,900 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/7008e3cbfe9e40599637cb6d88fd87f4 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/7008e3cbfe9e40599637cb6d88fd87f4 2023-02-13 04:56:22,921 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7008e3cbfe9e40599637cb6d88fd87f4 2023-02-13 04:56:22,921 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/7008e3cbfe9e40599637cb6d88fd87f4, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 04:56:22,922 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/473143a529674a058379a57237abd838 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/473143a529674a058379a57237abd838 2023-02-13 04:56:22,925 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 473143a529674a058379a57237abd838 2023-02-13 04:56:22,925 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/473143a529674a058379a57237abd838, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 04:56:22,926 INFO [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 63d8864f440c3c313b1eb8310d5cd3db in 1766ms, sequenceid=23, compaction requested=true 2023-02-13 04:56:22,926 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 63d8864f440c3c313b1eb8310d5cd3db: 2023-02-13 04:56:22,926 DEBUG [rs(jenkins-hbase4.apache.org,37513,1676264019660)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 04:56:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 04:56:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 04:56:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 04:56:22,928 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,928 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:22,928 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:22,928 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:56:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:22,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37513,1676264019660' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 04:56:22,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26580aaa[Count = 0] remaining members to acquire global barrier 2023-02-13 04:56:22,929 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 04:56:22,929 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:22,931 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:22,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:22,931 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 04:56:22,931 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 04:56:22,931 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,931 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:56:22,931 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,37513,1676264019660' in zk 2023-02-13 04:56:22,933 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 04:56:22,933 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,933 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:22,933 DEBUG [member: 'jenkins-hbase4.apache.org,37513,1676264019660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 04:56:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,37513,1676264019660': 2023-02-13 04:56:22,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37513,1676264019660' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 04:56:22,936 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 04:56:22,936 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:56:22,936 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:56:22,936 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 04:56:22,936 INFO [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:56:22,938 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:22,938 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:22,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:22,938 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:56:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:56:22,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:22,938 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:56:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:56:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:22,939 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:56:22,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 04:56:22,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:22,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:22,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 04:56:22,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:56:22,942 DEBUG [(jenkins-hbase4.apache.org,36431,1676264018484)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:56:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 04:56:22,942 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:56:22,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:56:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:56:23,042 DEBUG [Listener at localhost/37751] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:56:23,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36431] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:56:23,043 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:56:23,044 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 4c9709d2533d414215f87f6eef92b74b/family1 is initiating major compaction (all files) 2023-02-13 04:56:23,044 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:56:23,044 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:56:23,044 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 4c9709d2533d414215f87f6eef92b74b/family1 in testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:23,044 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/129f279aebf74ed8a3619fd415fc624f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/f89362636d8e46878bb2135029524a35, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/ec3830e930774e39afcf540e8f8a7985, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/6fbdeebdef5342e1838ec437e9b080d7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/e2bd709aed4946dabb2b4642efb14ef0] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp, totalSize=27.1 K 2023-02-13 04:56:23,045 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 129f279aebf74ed8a3619fd415fc624f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264173917 2023-02-13 04:56:23,045 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting f89362636d8e46878bb2135029524a35, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264175805 2023-02-13 04:56:23,045 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting ec3830e930774e39afcf540e8f8a7985, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264177677 2023-02-13 04:56:23,046 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 6fbdeebdef5342e1838ec437e9b080d7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264179537 2023-02-13 04:56:23,046 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting e2bd709aed4946dabb2b4642efb14ef0, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:56:23,057 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 4c9709d2533d414215f87f6eef92b74b#family1#compaction#197 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:56:23,506 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213cb2eba90d2bd44c982c91c0d3ccf873f_del 2023-02-13 04:56:23,506 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213cb2eba90d2bd44c982c91c0d3ccf873f_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213cb2eba90d2bd44c982c91c0d3ccf873f_del 2023-02-13 04:56:24,358 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7640f5dc6a4423682d6e03c0db2ccdf 2023-02-13 04:56:24,359 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family1/b7640f5dc6a4423682d6e03c0db2ccdf as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/b7640f5dc6a4423682d6e03c0db2ccdf 2023-02-13 04:56:24,386 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7640f5dc6a4423682d6e03c0db2ccdf 2023-02-13 04:56:24,387 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4c9709d2533d414215f87f6eef92b74b/family1 of 4c9709d2533d414215f87f6eef92b74b into b7640f5dc6a4423682d6e03c0db2ccdf(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:56:24,387 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 4c9709d2533d414215f87f6eef92b74b: 2023-02-13 04:56:24,387 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:56:24,387 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 4c9709d2533d414215f87f6eef92b74b/family2 is initiating major compaction (all files) 2023-02-13 04:56:24,388 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:56:24,388 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:56:24,388 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 4c9709d2533d414215f87f6eef92b74b/family2 in testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:24,388 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/0e14a5cab9854b289d75ab0ad22f4e91, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/591814751c7b47b3a6e67964e0966837, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c7b3fd8602f649449fdbf369d075b1ae, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c3b3ccc896c644fe90fa947aa90d0397, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/013cc1be2360477fa6f5ca9257af6a58] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp, totalSize=25.4 K 2023-02-13 04:56:24,388 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 0e14a5cab9854b289d75ab0ad22f4e91, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264173917 2023-02-13 04:56:24,389 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 591814751c7b47b3a6e67964e0966837, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264175805 2023-02-13 04:56:24,389 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting c7b3fd8602f649449fdbf369d075b1ae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264177677 2023-02-13 04:56:24,389 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting c3b3ccc896c644fe90fa947aa90d0397, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264179537 2023-02-13 04:56:24,390 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 013cc1be2360477fa6f5ca9257af6a58, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:56:24,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/129f279aebf74ed8a3619fd415fc624f, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/f89362636d8e46878bb2135029524a35, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/ec3830e930774e39afcf540e8f8a7985, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/6fbdeebdef5342e1838ec437e9b080d7, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/e2bd709aed4946dabb2b4642efb14ef0] to archive 2023-02-13 04:56:24,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:24,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/129f279aebf74ed8a3619fd415fc624f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/129f279aebf74ed8a3619fd415fc624f 2023-02-13 04:56:24,398 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 4c9709d2533d414215f87f6eef92b74b#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:56:24,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/f89362636d8e46878bb2135029524a35 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/f89362636d8e46878bb2135029524a35 2023-02-13 04:56:24,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/ec3830e930774e39afcf540e8f8a7985 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/ec3830e930774e39afcf540e8f8a7985 2023-02-13 04:56:24,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/6fbdeebdef5342e1838ec437e9b080d7 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/6fbdeebdef5342e1838ec437e9b080d7 2023-02-13 04:56:24,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/e2bd709aed4946dabb2b4642efb14ef0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/e2bd709aed4946dabb2b4642efb14ef0 2023-02-13 04:56:24,812 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021384c0b271b979464fb6157657ae35581b_del 2023-02-13 04:56:24,812 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021384c0b271b979464fb6157657ae35581b_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021384c0b271b979464fb6157657ae35581b_del 2023-02-13 04:56:25,626 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6811778940b0441b99a03b6c5ee21888 2023-02-13 04:56:25,627 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/.tmp/family2/6811778940b0441b99a03b6c5ee21888 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/6811778940b0441b99a03b6c5ee21888 2023-02-13 04:56:25,630 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6811778940b0441b99a03b6c5ee21888 2023-02-13 04:56:25,631 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4c9709d2533d414215f87f6eef92b74b/family2 of 4c9709d2533d414215f87f6eef92b74b into 6811778940b0441b99a03b6c5ee21888(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 04:56:25,631 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 4c9709d2533d414215f87f6eef92b74b: 2023-02-13 04:56:25,631 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:56:25,631 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 6dbfce3ec623083abb6cac001ddc4fd8/family1 is initiating major compaction (all files) 2023-02-13 04:56:25,632 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:56:25,632 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:56:25,634 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 6dbfce3ec623083abb6cac001ddc4fd8/family1 in testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:25,634 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/67b95c40914a459f8ba7dce06adf3ef8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/e55b05898fb44df793569c3bc23140ce, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/d54fdc0d452a44e0842e22403d59c588, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/a97a29d372af4b9a9763afcdb4eaafee, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/7ca7851209ba4e9590f1c0cd6f7f5688] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp, totalSize=27.1 K 2023-02-13 04:56:25,634 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 67b95c40914a459f8ba7dce06adf3ef8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264173917 2023-02-13 04:56:25,635 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting e55b05898fb44df793569c3bc23140ce, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264175805 2023-02-13 04:56:25,635 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting d54fdc0d452a44e0842e22403d59c588, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264177677 2023-02-13 04:56:25,635 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting a97a29d372af4b9a9763afcdb4eaafee, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264179538 2023-02-13 04:56:25,636 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 7ca7851209ba4e9590f1c0cd6f7f5688, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:56:25,646 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 6dbfce3ec623083abb6cac001ddc4fd8#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:56:25,694 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213b247923ddc254097bd41255efb01f6d7_del 2023-02-13 04:56:25,694 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213b247923ddc254097bd41255efb01f6d7_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213b247923ddc254097bd41255efb01f6d7_del 2023-02-13 04:56:25,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/0e14a5cab9854b289d75ab0ad22f4e91, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/591814751c7b47b3a6e67964e0966837, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c7b3fd8602f649449fdbf369d075b1ae, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c3b3ccc896c644fe90fa947aa90d0397, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/013cc1be2360477fa6f5ca9257af6a58] to archive 2023-02-13 04:56:25,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:25,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/0e14a5cab9854b289d75ab0ad22f4e91 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/0e14a5cab9854b289d75ab0ad22f4e91 2023-02-13 04:56:25,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/591814751c7b47b3a6e67964e0966837 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/591814751c7b47b3a6e67964e0966837 2023-02-13 04:56:25,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c7b3fd8602f649449fdbf369d075b1ae to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c7b3fd8602f649449fdbf369d075b1ae 2023-02-13 04:56:25,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c3b3ccc896c644fe90fa947aa90d0397 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/c3b3ccc896c644fe90fa947aa90d0397 2023-02-13 04:56:25,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/013cc1be2360477fa6f5ca9257af6a58 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family2/013cc1be2360477fa6f5ca9257af6a58 2023-02-13 04:56:26,555 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f2d73b3abba4832b7fa7f72bf2ffde4 2023-02-13 04:56:26,556 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family1/1f2d73b3abba4832b7fa7f72bf2ffde4 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/1f2d73b3abba4832b7fa7f72bf2ffde4 2023-02-13 04:56:26,578 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f2d73b3abba4832b7fa7f72bf2ffde4 2023-02-13 04:56:26,579 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6dbfce3ec623083abb6cac001ddc4fd8/family1 of 6dbfce3ec623083abb6cac001ddc4fd8 into 1f2d73b3abba4832b7fa7f72bf2ffde4(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:56:26,579 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 6dbfce3ec623083abb6cac001ddc4fd8: 2023-02-13 04:56:26,579 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:56:26,579 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 6dbfce3ec623083abb6cac001ddc4fd8/family2 is initiating major compaction (all files) 2023-02-13 04:56:26,579 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:56:26,580 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:56:26,580 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 6dbfce3ec623083abb6cac001ddc4fd8/family2 in testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:26,581 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/5189c855a9474f93afc71b9b1dd59eb1, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/736fb9f413954ad3957396f1715cb8cc, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/7476386f904a417faebc2b42d2b9c804, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/f655143e760e43748560281490dd5871, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/967bcc0819354702a36edb0dd54c1e31] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp, totalSize=25.4 K 2023-02-13 04:56:26,581 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 5189c855a9474f93afc71b9b1dd59eb1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264173917 2023-02-13 04:56:26,582 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 736fb9f413954ad3957396f1715cb8cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264175805 2023-02-13 04:56:26,582 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 7476386f904a417faebc2b42d2b9c804, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264177677 2023-02-13 04:56:26,582 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting f655143e760e43748560281490dd5871, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264179538 2023-02-13 04:56:26,583 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 967bcc0819354702a36edb0dd54c1e31, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:56:26,590 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 6dbfce3ec623083abb6cac001ddc4fd8#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:56:26,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/67b95c40914a459f8ba7dce06adf3ef8, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/e55b05898fb44df793569c3bc23140ce, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/d54fdc0d452a44e0842e22403d59c588, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/a97a29d372af4b9a9763afcdb4eaafee, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/7ca7851209ba4e9590f1c0cd6f7f5688] to archive 2023-02-13 04:56:26,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:26,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/67b95c40914a459f8ba7dce06adf3ef8 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/67b95c40914a459f8ba7dce06adf3ef8 2023-02-13 04:56:26,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/e55b05898fb44df793569c3bc23140ce to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/e55b05898fb44df793569c3bc23140ce 2023-02-13 04:56:26,600 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302131c8f5d5f0efe4cb3b499b31546f2689f_del 2023-02-13 04:56:26,601 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302131c8f5d5f0efe4cb3b499b31546f2689f_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302131c8f5d5f0efe4cb3b499b31546f2689f_del 2023-02-13 04:56:26,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/d54fdc0d452a44e0842e22403d59c588 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/d54fdc0d452a44e0842e22403d59c588 2023-02-13 04:56:26,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/a97a29d372af4b9a9763afcdb4eaafee to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/a97a29d372af4b9a9763afcdb4eaafee 2023-02-13 04:56:26,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/7ca7851209ba4e9590f1c0cd6f7f5688 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/7ca7851209ba4e9590f1c0cd6f7f5688 2023-02-13 04:56:26,624 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d6b9dcca9cb4543b0adeb81e8e67b60 2023-02-13 04:56:26,625 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/.tmp/family2/9d6b9dcca9cb4543b0adeb81e8e67b60 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/9d6b9dcca9cb4543b0adeb81e8e67b60 2023-02-13 04:56:26,628 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d6b9dcca9cb4543b0adeb81e8e67b60 2023-02-13 04:56:26,630 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6dbfce3ec623083abb6cac001ddc4fd8/family2 of 6dbfce3ec623083abb6cac001ddc4fd8 into 9d6b9dcca9cb4543b0adeb81e8e67b60(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:56:26,630 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 6dbfce3ec623083abb6cac001ddc4fd8: 2023-02-13 04:56:26,630 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:56:26,630 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 63d8864f440c3c313b1eb8310d5cd3db/family1 is initiating major compaction (all files) 2023-02-13 04:56:26,631 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:56:26,631 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:56:26,632 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 63d8864f440c3c313b1eb8310d5cd3db/family1 in testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:26,632 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/06a2beb670a643eaa261fd6b6e903aee, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/0fbeffe9b98141eba39c8dea6dfb3833, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/cbb6de070390453e8a6d905d90971c42, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/19b04e0825b842cbbf826cb99f3b2338, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/7008e3cbfe9e40599637cb6d88fd87f4] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp, totalSize=27.1 K 2023-02-13 04:56:26,632 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 06a2beb670a643eaa261fd6b6e903aee, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264173916 2023-02-13 04:56:26,633 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 0fbeffe9b98141eba39c8dea6dfb3833, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264175805 2023-02-13 04:56:26,633 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting cbb6de070390453e8a6d905d90971c42, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264177676 2023-02-13 04:56:26,634 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 19b04e0825b842cbbf826cb99f3b2338, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264179537 2023-02-13 04:56:26,634 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 7008e3cbfe9e40599637cb6d88fd87f4, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:56:26,647 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 63d8864f440c3c313b1eb8310d5cd3db#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:56:26,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/5189c855a9474f93afc71b9b1dd59eb1, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/736fb9f413954ad3957396f1715cb8cc, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/7476386f904a417faebc2b42d2b9c804, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/f655143e760e43748560281490dd5871, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/967bcc0819354702a36edb0dd54c1e31] to archive 2023-02-13 04:56:26,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:26,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/5189c855a9474f93afc71b9b1dd59eb1 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/5189c855a9474f93afc71b9b1dd59eb1 2023-02-13 04:56:26,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/736fb9f413954ad3957396f1715cb8cc to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/736fb9f413954ad3957396f1715cb8cc 2023-02-13 04:56:26,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/7476386f904a417faebc2b42d2b9c804 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/7476386f904a417faebc2b42d2b9c804 2023-02-13 04:56:26,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/f655143e760e43748560281490dd5871 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/f655143e760e43748560281490dd5871 2023-02-13 04:56:26,707 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213abd7ceafac764ba88f746b0d28332944_del 2023-02-13 04:56:26,707 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213abd7ceafac764ba88f746b0d28332944_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213abd7ceafac764ba88f746b0d28332944_del 2023-02-13 04:56:26,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/967bcc0819354702a36edb0dd54c1e31 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family2/967bcc0819354702a36edb0dd54c1e31 2023-02-13 04:56:27,170 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e545b84a9f8a4e09ba6ee89bcd27b1e5 2023-02-13 04:56:27,170 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family1/e545b84a9f8a4e09ba6ee89bcd27b1e5 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/e545b84a9f8a4e09ba6ee89bcd27b1e5 2023-02-13 04:56:27,202 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e545b84a9f8a4e09ba6ee89bcd27b1e5 2023-02-13 04:56:27,203 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 63d8864f440c3c313b1eb8310d5cd3db/family1 of 63d8864f440c3c313b1eb8310d5cd3db into e545b84a9f8a4e09ba6ee89bcd27b1e5(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:56:27,204 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 63d8864f440c3c313b1eb8310d5cd3db: 2023-02-13 04:56:27,204 DEBUG [Listener at localhost/37751] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 04:56:27,204 DEBUG [Listener at localhost/37751] regionserver.HStore(1912): 63d8864f440c3c313b1eb8310d5cd3db/family2 is initiating major compaction (all files) 2023-02-13 04:56:27,204 INFO [Listener at localhost/37751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:56:27,204 INFO [Listener at localhost/37751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:56:27,204 INFO [Listener at localhost/37751] regionserver.HRegion(2258): Starting compaction of 63d8864f440c3c313b1eb8310d5cd3db/family2 in testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:27,204 INFO [Listener at localhost/37751] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/b9fef430f99b4bdab01d5771da4c552c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/275e6e0d8ed34740ae3ebf33d72a4452, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/727d9841937e4c5584511d85c2f5ec4c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/607a69a1e71d4dd295481c194d549a7d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/473143a529674a058379a57237abd838] into tmpdir=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp, totalSize=25.4 K 2023-02-13 04:56:27,205 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting b9fef430f99b4bdab01d5771da4c552c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676264173916 2023-02-13 04:56:27,205 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 275e6e0d8ed34740ae3ebf33d72a4452, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676264175805 2023-02-13 04:56:27,206 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 727d9841937e4c5584511d85c2f5ec4c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676264177676 2023-02-13 04:56:27,206 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 607a69a1e71d4dd295481c194d549a7d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676264179537 2023-02-13 04:56:27,206 DEBUG [Listener at localhost/37751] compactions.Compactor(207): Compacting 473143a529674a058379a57237abd838, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 04:56:27,215 INFO [Listener at localhost/37751] throttle.PressureAwareThroughputController(145): 63d8864f440c3c313b1eb8310d5cd3db#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 04:56:27,222 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302130e143f867994451aa841caac48084f91_del 2023-02-13 04:56:27,223 INFO [Listener at localhost/37751] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302130e143f867994451aa841caac48084f91_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302130e143f867994451aa841caac48084f91_del 2023-02-13 04:56:27,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/06a2beb670a643eaa261fd6b6e903aee, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/0fbeffe9b98141eba39c8dea6dfb3833, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/cbb6de070390453e8a6d905d90971c42, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/19b04e0825b842cbbf826cb99f3b2338, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/7008e3cbfe9e40599637cb6d88fd87f4] to archive 2023-02-13 04:56:27,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:27,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/06a2beb670a643eaa261fd6b6e903aee to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/06a2beb670a643eaa261fd6b6e903aee 2023-02-13 04:56:27,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/0fbeffe9b98141eba39c8dea6dfb3833 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/0fbeffe9b98141eba39c8dea6dfb3833 2023-02-13 04:56:27,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/cbb6de070390453e8a6d905d90971c42 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/cbb6de070390453e8a6d905d90971c42 2023-02-13 04:56:27,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/19b04e0825b842cbbf826cb99f3b2338 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/19b04e0825b842cbbf826cb99f3b2338 2023-02-13 04:56:27,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/7008e3cbfe9e40599637cb6d88fd87f4 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/7008e3cbfe9e40599637cb6d88fd87f4 2023-02-13 04:56:28,037 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61f7ee61856e450a8948f7d5926d603b 2023-02-13 04:56:28,038 DEBUG [Listener at localhost/37751] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/.tmp/family2/61f7ee61856e450a8948f7d5926d603b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/61f7ee61856e450a8948f7d5926d603b 2023-02-13 04:56:28,041 INFO [Listener at localhost/37751] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61f7ee61856e450a8948f7d5926d603b 2023-02-13 04:56:28,042 INFO [Listener at localhost/37751] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 63d8864f440c3c313b1eb8310d5cd3db/family2 of 63d8864f440c3c313b1eb8310d5cd3db into 61f7ee61856e450a8948f7d5926d603b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 04:56:28,042 DEBUG [Listener at localhost/37751] regionserver.HRegion(2288): Compaction status journal for 63d8864f440c3c313b1eb8310d5cd3db: 2023-02-13 04:56:28,044 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:56:28,047 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:56:28,050 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:56:28,050 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:56:28,055 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36431] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x5Cd\xC0\xAE\x90V\x91\xC0T\xE2\xE6J\xDE\x10\x04\xBA"\x10\xAC\xF9M\xE3\xD8\xBE\xADq\xFD\xE73^GT\x08\x92*\x10\xE9\xC5\xE1F\xF5\xDDmG\xE8B\xC8\xB1\x9395T2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-13 04:56:28,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 04:56:28,076 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 04:56:28,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:56:28,076 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676264788076 2023-02-13 04:56:28,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 04:56:28,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/b9fef430f99b4bdab01d5771da4c552c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/275e6e0d8ed34740ae3ebf33d72a4452, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/727d9841937e4c5584511d85c2f5ec4c, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/607a69a1e71d4dd295481c194d549a7d, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/473143a529674a058379a57237abd838] to archive 2023-02-13 04:56:28,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:28,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/b9fef430f99b4bdab01d5771da4c552c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/b9fef430f99b4bdab01d5771da4c552c 2023-02-13 04:56:28,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/275e6e0d8ed34740ae3ebf33d72a4452 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/275e6e0d8ed34740ae3ebf33d72a4452 2023-02-13 04:56:28,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/727d9841937e4c5584511d85c2f5ec4c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/727d9841937e4c5584511d85c2f5ec4c 2023-02-13 04:56:28,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/607a69a1e71d4dd295481c194d549a7d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/607a69a1e71d4dd295481c194d549a7d 2023-02-13 04:56:28,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/473143a529674a058379a57237abd838 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family2/473143a529674a058379a57237abd838 2023-02-13 04:56:28,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-13 04:56:28,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213abd7ceafac764ba88f746b0d28332944_del 2023-02-13 04:56:28,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213cb2eba90d2bd44c982c91c0d3ccf873f_del 2023-02-13 04:56:28,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213b247923ddc254097bd41255efb01f6d7_del 2023-02-13 04:56:28,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 04:56:28,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] zookeeper.ReadOnlyZKClient(139): Connect 0x4ce7e9db to 127.0.0.1:54862 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:56:28,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41ba20f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:56:28,454 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 04:56:28,484 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 04:56:29,399 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213dd8b2035653b463a9ad5752a3dcd73b0 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213dd8b2035653b463a9ad5752a3dcd73b0 2023-02-13 04:56:29,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 04:56:29,411 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:56:29,413 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60564, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:56:29,427 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:56:29,429 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36356, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:56:29,458 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/244f12d535224020a587ed25b0f22df6 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 04:56:29,459 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/244f12d535224020a587ed25b0f22df6}] 2023-02-13 04:56:29,465 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/244f12d535224020a587ed25b0f22df6 for inclusion in 4c9709d2533d414215f87f6eef92b74b/family1 2023-02-13 04:56:29,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 04:56:29,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 04:56:29,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 4c9709d2533d414215f87f6eef92b74b: 2023-02-13 04:56:29,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/244f12d535224020a587ed25b0f22df6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__9ehvqrv9i3bt2pf02ujhpfd7dl3t6j7u88ebds3a3eghce5qo2a34ira8mnm93d3/family1/244f12d535224020a587ed25b0f22df6 2023-02-13 04:56:29,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__9ehvqrv9i3bt2pf02ujhpfd7dl3t6j7u88ebds3a3eghce5qo2a34ira8mnm93d3/family1/244f12d535224020a587ed25b0f22df6 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/b697a8acfb0c45749b32d6f67c6c6738_SeqId_28_ 2023-02-13 04:56:29,499 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__9ehvqrv9i3bt2pf02ujhpfd7dl3t6j7u88ebds3a3eghce5qo2a34ira8mnm93d3/family1/244f12d535224020a587ed25b0f22df6 into 4c9709d2533d414215f87f6eef92b74b/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/b697a8acfb0c45749b32d6f67c6c6738_SeqId_28_ - updating store file list. 2023-02-13 04:56:29,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/b697a8acfb0c45749b32d6f67c6c6738_SeqId_28_ into 4c9709d2533d414215f87f6eef92b74b/family1 2023-02-13 04:56:29,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__9ehvqrv9i3bt2pf02ujhpfd7dl3t6j7u88ebds3a3eghce5qo2a34ira8mnm93d3/family1/244f12d535224020a587ed25b0f22df6 into 4c9709d2533d414215f87f6eef92b74b/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/family1/b697a8acfb0c45749b32d6f67c6c6738_SeqId_28_) 2023-02-13 04:56:29,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__9ehvqrv9i3bt2pf02ujhpfd7dl3t6j7u88ebds3a3eghce5qo2a34ira8mnm93d3/family1/244f12d535224020a587ed25b0f22df6 2023-02-13 04:56:29,523 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 04:56:29,524 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:29,525 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021339af4ec3a22c4d7fb8f0f771d60d4954 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021339af4ec3a22c4d7fb8f0f771d60d4954 2023-02-13 04:56:29,526 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021352f8059a5f5e4814b5603fce121af87f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021352f8059a5f5e4814b5603fce121af87f 2023-02-13 04:56:29,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213be49a3d0ef8e43a1a4d6373fa919528f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213be49a3d0ef8e43a1a4d6373fa919528f 2023-02-13 04:56:29,528 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213c121e82d741a414e8c656d0005fba462 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213c121e82d741a414e8c656d0005fba462 2023-02-13 04:56:29,528 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 04:56:29,528 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 04:56:29,528 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 04:56:29,528 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 04:56:29,673 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213be837adee7c24bd997a8bfcf3230296d to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213be837adee7c24bd997a8bfcf3230296d 2023-02-13 04:56:29,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 04:56:29,724 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 04:56:29,728 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/f6ab79750827428d8668b8c6f5c1782f first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 04:56:29,729 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/f6ab79750827428d8668b8c6f5c1782f}] 2023-02-13 04:56:29,731 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/f6ab79750827428d8668b8c6f5c1782f for inclusion in 6dbfce3ec623083abb6cac001ddc4fd8/family1 2023-02-13 04:56:29,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 04:56:29,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 04:56:29,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 6dbfce3ec623083abb6cac001ddc4fd8: 2023-02-13 04:56:29,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/f6ab79750827428d8668b8c6f5c1782f to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__i4ir7vf6jib1cqjuknhs5thtc31i7q9n3fmlo3rkh30jh7mh5ohklustg7v7p65e/family1/f6ab79750827428d8668b8c6f5c1782f 2023-02-13 04:56:29,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__i4ir7vf6jib1cqjuknhs5thtc31i7q9n3fmlo3rkh30jh7mh5ohklustg7v7p65e/family1/f6ab79750827428d8668b8c6f5c1782f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/078708bcd9c34ac79fdc448a57acc6bf_SeqId_28_ 2023-02-13 04:56:29,756 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__i4ir7vf6jib1cqjuknhs5thtc31i7q9n3fmlo3rkh30jh7mh5ohklustg7v7p65e/family1/f6ab79750827428d8668b8c6f5c1782f into 6dbfce3ec623083abb6cac001ddc4fd8/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/078708bcd9c34ac79fdc448a57acc6bf_SeqId_28_ - updating store file list. 2023-02-13 04:56:29,787 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/078708bcd9c34ac79fdc448a57acc6bf_SeqId_28_ into 6dbfce3ec623083abb6cac001ddc4fd8/family1 2023-02-13 04:56:29,788 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__i4ir7vf6jib1cqjuknhs5thtc31i7q9n3fmlo3rkh30jh7mh5ohklustg7v7p65e/family1/f6ab79750827428d8668b8c6f5c1782f into 6dbfce3ec623083abb6cac001ddc4fd8/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/family1/078708bcd9c34ac79fdc448a57acc6bf_SeqId_28_) 2023-02-13 04:56:29,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__i4ir7vf6jib1cqjuknhs5thtc31i7q9n3fmlo3rkh30jh7mh5ohklustg7v7p65e/family1/f6ab79750827428d8668b8c6f5c1782f 2023-02-13 04:56:29,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 04:56:29,790 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:29,792 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021353d463d1b6ea4d83ab05a7cabd675661 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021353d463d1b6ea4d83ab05a7cabd675661 2023-02-13 04:56:29,793 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139276bf681bd64e84acb8e82a426fef86 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139276bf681bd64e84acb8e82a426fef86 2023-02-13 04:56:29,793 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139cc9231424ff4497a6ace9423ac728cb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302139cc9231424ff4497a6ace9423ac728cb 2023-02-13 04:56:29,794 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213f8aeebf2acc944e09f2a30fdf0e64abf to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213f8aeebf2acc944e09f2a30fdf0e64abf 2023-02-13 04:56:29,794 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 04:56:29,794 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 04:56:29,795 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 04:56:29,795 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 04:56:30,747 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213ce3571d812974a5d866a64247b1249bb to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213ce3571d812974a5d866a64247b1249bb 2023-02-13 04:56:30,748 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 04:56:30,805 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/fc44fc0e2f9c4d48baacd72aa6f3efa3 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 04:56:30,806 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db., hostname=jenkins-hbase4.apache.org,37513,1676264019660, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/fc44fc0e2f9c4d48baacd72aa6f3efa3}] 2023-02-13 04:56:30,809 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(763): Validating hfile at hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/fc44fc0e2f9c4d48baacd72aa6f3efa3 for inclusion in 63d8864f440c3c313b1eb8310d5cd3db/family1 2023-02-13 04:56:30,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 04:56:30,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 04:56:30,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegion(2445): Flush status journal for 63d8864f440c3c313b1eb8310d5cd3db: 2023-02-13 04:56:30,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/fc44fc0e2f9c4d48baacd72aa6f3efa3 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__r76gh605olgvc2127kovavm85i5uqbr2cid9drm7thgu6r2epdn8dee4paip9co5/family1/fc44fc0e2f9c4d48baacd72aa6f3efa3 2023-02-13 04:56:30,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__r76gh605olgvc2127kovavm85i5uqbr2cid9drm7thgu6r2epdn8dee4paip9co5/family1/fc44fc0e2f9c4d48baacd72aa6f3efa3 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/90c4000c62ac4b46a7e528b645e17bb4_SeqId_28_ 2023-02-13 04:56:30,834 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(849): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__r76gh605olgvc2127kovavm85i5uqbr2cid9drm7thgu6r2epdn8dee4paip9co5/family1/fc44fc0e2f9c4d48baacd72aa6f3efa3 into 63d8864f440c3c313b1eb8310d5cd3db/family1 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/90c4000c62ac4b46a7e528b645e17bb4_SeqId_28_ - updating store file list. 2023-02-13 04:56:30,869 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(882): Loaded HFile hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/90c4000c62ac4b46a7e528b645e17bb4_SeqId_28_ into 63d8864f440c3c313b1eb8310d5cd3db/family1 2023-02-13 04:56:30,869 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.HStore(855): Successfully loaded hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__r76gh605olgvc2127kovavm85i5uqbr2cid9drm7thgu6r2epdn8dee4paip9co5/family1/fc44fc0e2f9c4d48baacd72aa6f3efa3 into 63d8864f440c3c313b1eb8310d5cd3db/family1 (new location: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/family1/90c4000c62ac4b46a7e528b645e17bb4_SeqId_28_) 2023-02-13 04:56:30,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37513] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/staging/jenkins__testMajorCompactionFromAdmin__r76gh605olgvc2127kovavm85i5uqbr2cid9drm7thgu6r2epdn8dee4paip9co5/family1/fc44fc0e2f9c4d48baacd72aa6f3efa3 2023-02-13 04:56:30,871 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 04:56:30,871 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:30,872 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021337b0c737c5c94ab3bb6db4d2910e0ad6 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021337b0c737c5c94ab3bb6db4d2910e0ad6 2023-02-13 04:56:30,873 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021396b915b9b2f541bda883c8cba014f230 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021396b915b9b2f541bda883c8cba014f230 2023-02-13 04:56:30,874 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302139ab3038e028b4baa8231b1d8d439f77c to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302139ab3038e028b4baa8231b1d8d439f77c 2023-02-13 04:56:30,875 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213f951d2106a06497391bad24611e5dca5 to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213f951d2106a06497391bad24611e5dca5 2023-02-13 04:56:30,875 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 04:56:30,875 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 04:56:30,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 04:56:30,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 04:56:30,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 04:56:30,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213abd7ceafac764ba88f746b0d28332944_del] 2023-02-13 04:56:30,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:30,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213abd7ceafac764ba88f746b0d28332944_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213abd7ceafac764ba88f746b0d28332944_del 2023-02-13 04:56:30,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 04:56:30,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213cb2eba90d2bd44c982c91c0d3ccf873f_del] 2023-02-13 04:56:30,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:30,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213cb2eba90d2bd44c982c91c0d3ccf873f_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213cb2eba90d2bd44c982c91c0d3ccf873f_del 2023-02-13 04:56:30,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 04:56:30,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213b247923ddc254097bd41255efb01f6d7_del] 2023-02-13 04:56:30,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 04:56:30,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213b247923ddc254097bd41255efb01f6d7_del to hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213b247923ddc254097bd41255efb01f6d7_del 2023-02-13 04:56:30,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 04:56:30,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676264023491] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 04:56:30,881 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 04:56:30,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.8070 sec 2023-02-13 04:56:30,900 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:56:30,902 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:56:30,905 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 04:56:30,905 DEBUG [Listener at localhost/37751] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 04:56:30,909 INFO [Listener at localhost/37751] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:56:30,943 INFO [Listener at localhost/37751] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=248 (was 256), OpenFileDescriptor=635 (was 643), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=137 (was 127) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3659 (was 3486) - AvailableMemoryMB LEAK? - 2023-02-13 04:56:30,943 DEBUG [Listener at localhost/37751] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e2f2d5d to 127.0.0.1:54862 2023-02-13 04:56:30,944 DEBUG [Listener at localhost/37751] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:56:30,944 INFO [Listener at localhost/37751] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 04:56:30,944 INFO [Listener at localhost/37751] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:56:30,944 DEBUG [Listener at localhost/37751] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x515b7931 to 127.0.0.1:54862 2023-02-13 04:56:30,944 DEBUG [Listener at localhost/37751] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:56:30,944 DEBUG [Listener at localhost/37751] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 04:56:30,944 DEBUG [Listener at localhost/37751] util.JVMClusterUtil(257): Found active master hash=1114423959, stopped=false 2023-02-13 04:56:30,944 INFO [Listener at localhost/37751] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:56:30,946 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:56:30,946 INFO [Listener at localhost/37751] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 04:56:30,946 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:56:30,946 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:56:30,946 DEBUG [Listener at localhost/37751] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08b7ac94 to 127.0.0.1:54862 2023-02-13 04:56:30,946 DEBUG [Listener at localhost/37751] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:56:30,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:56:30,947 INFO [Listener at localhost/37751] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37513,1676264019660' ***** 2023-02-13 04:56:30,947 INFO [Listener at localhost/37751] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:56:30,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:56:30,947 INFO [RS:0;jenkins-hbase4:37513] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:56:30,947 INFO [RS:0;jenkins-hbase4:37513] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:56:30,947 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:56:30,947 INFO [RS:0;jenkins-hbase4:37513] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:56:30,947 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 7e59983b3de5930ab2ae0397fa6dba0d 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 8cb2fc4355445fe1dc5705702cd065d7 2023-02-13 04:56:30,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f959d9fe54998a7bac6e6957f0f0316c, disabling compactions & flushes 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for e1fe4f9b4d232b0b98c8aa4a897a443f 2023-02-13 04:56:30,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for e3140d42d553dab37e6b41019f32deeb 2023-02-13 04:56:30,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 48697bb307a98b9544461b85dd69ae57 2023-02-13 04:56:30,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. after waiting 0 ms 2023-02-13 04:56:30,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 6d63ec892cabd8db21fc52a71cc505d3 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 5da706e80ec7bbb4fd54525c6463321f 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 761c0e5bb8f03a25298dfc51c2ad6940 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 33ece068d353171a34dc973e93f1580e 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for c2a39fa957db2c535903d705efd223f5 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 4c9709d2533d414215f87f6eef92b74b 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 2b73a7398b958006c5f263c04e379210 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 6dbfce3ec623083abb6cac001ddc4fd8 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for df6dd8289209e33a66ab42a45700acff 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 63d8864f440c3c313b1eb8310d5cd3db 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 8937f228f64ed9a20627ea05b6572001 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 884e4256c9aa5930bdd891bcf997257a 2023-02-13 04:56:30,948 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 22d440af5bfcfc9939787c5bb9ea8367 2023-02-13 04:56:30,949 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:30,949 DEBUG [RS:0;jenkins-hbase4:37513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68922268 to 127.0.0.1:54862 2023-02-13 04:56:30,949 DEBUG [RS:0;jenkins-hbase4:37513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:56:30,949 INFO [RS:0;jenkins-hbase4:37513] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:56:30,949 INFO [RS:0;jenkins-hbase4:37513] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:56:30,949 INFO [RS:0;jenkins-hbase4:37513] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:56:30,949 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 04:56:30,949 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-13 04:56:30,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:56:30,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:56:30,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:56:30,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:56:30,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:56:30,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-02-13 04:56:30,950 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1505): Waiting on 1588230740, 22d440af5bfcfc9939787c5bb9ea8367, 2b73a7398b958006c5f263c04e379210, 33ece068d353171a34dc973e93f1580e, 48697bb307a98b9544461b85dd69ae57, 4c9709d2533d414215f87f6eef92b74b, 5da706e80ec7bbb4fd54525c6463321f, 63d8864f440c3c313b1eb8310d5cd3db, 6d63ec892cabd8db21fc52a71cc505d3, 6dbfce3ec623083abb6cac001ddc4fd8, 761c0e5bb8f03a25298dfc51c2ad6940, 7e59983b3de5930ab2ae0397fa6dba0d, 884e4256c9aa5930bdd891bcf997257a, 8937f228f64ed9a20627ea05b6572001, 8cb2fc4355445fe1dc5705702cd065d7, c2a39fa957db2c535903d705efd223f5, df6dd8289209e33a66ab42a45700acff, e1fe4f9b4d232b0b98c8aa4a897a443f, e3140d42d553dab37e6b41019f32deeb, e994b917f8df7b3d815819b2163f57fb, f959d9fe54998a7bac6e6957f0f0316c 2023-02-13 04:56:30,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/f959d9fe54998a7bac6e6957f0f0316c/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 04:56:30,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:56:30,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f959d9fe54998a7bac6e6957f0f0316c: Waiting for close lock at 1676264190948Running coprocessor pre-close hooks at 1676264190948Disabling compacts and flushes for region at 1676264190948Disabling writes for close at 1676264190948Writing region close event to WAL at 1676264190949 (+1 ms)Running coprocessor post-close hooks at 1676264190952 (+3 ms)Closed at 1676264190953 (+1 ms) 2023-02-13 04:56:30,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676264112021.f959d9fe54998a7bac6e6957f0f0316c. 2023-02-13 04:56:30,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7e59983b3de5930ab2ae0397fa6dba0d, disabling compactions & flushes 2023-02-13 04:56:30,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:56:30,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:56:30,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. after waiting 0 ms 2023-02-13 04:56:30,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:56:30,958 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:56:30,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/7e59983b3de5930ab2ae0397fa6dba0d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 04:56:30,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:56:30,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7e59983b3de5930ab2ae0397fa6dba0d: Waiting for close lock at 1676264190953Running coprocessor pre-close hooks at 1676264190953Disabling compacts and flushes for region at 1676264190953Disabling writes for close at 1676264190953Writing region close event to WAL at 1676264190954 (+1 ms)Running coprocessor post-close hooks at 1676264190959 (+5 ms)Closed at 1676264190959 2023-02-13 04:56:30,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676264140517.7e59983b3de5930ab2ae0397fa6dba0d. 2023-02-13 04:56:30,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8cb2fc4355445fe1dc5705702cd065d7, disabling compactions & flushes 2023-02-13 04:56:30,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:56:30,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:56:30,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. after waiting 0 ms 2023-02-13 04:56:30,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:56:30,966 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 04:56:30,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8cb2fc4355445fe1dc5705702cd065d7/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 04:56:30,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:56:30,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8cb2fc4355445fe1dc5705702cd065d7: Waiting for close lock at 1676264190960Running coprocessor pre-close hooks at 1676264190960Disabling compacts and flushes for region at 1676264190960Disabling writes for close at 1676264190960Writing region close event to WAL at 1676264190964 (+4 ms)Running coprocessor post-close hooks at 1676264190967 (+3 ms)Closed at 1676264190967 2023-02-13 04:56:30,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676264112021.8cb2fc4355445fe1dc5705702cd065d7. 2023-02-13 04:56:30,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e1fe4f9b4d232b0b98c8aa4a897a443f, disabling compactions & flushes 2023-02-13 04:56:30,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:56:30,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:56:30,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. after waiting 0 ms 2023-02-13 04:56:30,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:56:30,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e1fe4f9b4d232b0b98c8aa4a897a443f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 04:56:30,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:56:30,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e1fe4f9b4d232b0b98c8aa4a897a443f: Waiting for close lock at 1676264190968Running coprocessor pre-close hooks at 1676264190968Disabling compacts and flushes for region at 1676264190968Disabling writes for close at 1676264190968Writing region close event to WAL at 1676264190968Running coprocessor post-close hooks at 1676264190971 (+3 ms)Closed at 1676264190971 2023-02-13 04:56:30,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676264059487.e1fe4f9b4d232b0b98c8aa4a897a443f. 2023-02-13 04:56:30,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e3140d42d553dab37e6b41019f32deeb, disabling compactions & flushes 2023-02-13 04:56:30,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:56:30,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:56:30,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. after waiting 0 ms 2023-02-13 04:56:30,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:56:30,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e3140d42d553dab37e6b41019f32deeb/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 04:56:30,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:56:30,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e3140d42d553dab37e6b41019f32deeb: Waiting for close lock at 1676264190971Running coprocessor pre-close hooks at 1676264190971Disabling compacts and flushes for region at 1676264190971Disabling writes for close at 1676264190971Writing region close event to WAL at 1676264190972 (+1 ms)Running coprocessor post-close hooks at 1676264190974 (+2 ms)Closed at 1676264190975 (+1 ms) 2023-02-13 04:56:30,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676264075833.e3140d42d553dab37e6b41019f32deeb. 2023-02-13 04:56:30,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 48697bb307a98b9544461b85dd69ae57, disabling compactions & flushes 2023-02-13 04:56:30,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:56:30,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:56:30,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. after waiting 0 ms 2023-02-13 04:56:30,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:56:30,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/48697bb307a98b9544461b85dd69ae57/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 04:56:30,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:56:30,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 48697bb307a98b9544461b85dd69ae57: Waiting for close lock at 1676264190975Running coprocessor pre-close hooks at 1676264190975Disabling compacts and flushes for region at 1676264190975Disabling writes for close at 1676264190975Writing region close event to WAL at 1676264190976 (+1 ms)Running coprocessor post-close hooks at 1676264190978 (+2 ms)Closed at 1676264190979 (+1 ms) 2023-02-13 04:56:30,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676264140517.48697bb307a98b9544461b85dd69ae57. 2023-02-13 04:56:30,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6d63ec892cabd8db21fc52a71cc505d3, disabling compactions & flushes 2023-02-13 04:56:30,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:56:30,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:56:30,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. after waiting 0 ms 2023-02-13 04:56:30,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:56:30,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/6d63ec892cabd8db21fc52a71cc505d3/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 04:56:30,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:56:30,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6d63ec892cabd8db21fc52a71cc505d3: Waiting for close lock at 1676264190979Running coprocessor pre-close hooks at 1676264190979Disabling compacts and flushes for region at 1676264190979Disabling writes for close at 1676264190979Writing region close event to WAL at 1676264190980 (+1 ms)Running coprocessor post-close hooks at 1676264190982 (+2 ms)Closed at 1676264190983 (+1 ms) 2023-02-13 04:56:30,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676264023614.6d63ec892cabd8db21fc52a71cc505d3. 2023-02-13 04:56:30,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5da706e80ec7bbb4fd54525c6463321f, disabling compactions & flushes 2023-02-13 04:56:30,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:30,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:30,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. after waiting 0 ms 2023-02-13 04:56:30,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:30,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithMonthlyPolicy/5da706e80ec7bbb4fd54525c6463321f/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 04:56:30,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:30,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5da706e80ec7bbb4fd54525c6463321f: Waiting for close lock at 1676264190983Running coprocessor pre-close hooks at 1676264190983Disabling compacts and flushes for region at 1676264190983Disabling writes for close at 1676264190983Writing region close event to WAL at 1676264190984 (+1 ms)Running coprocessor post-close hooks at 1676264190986 (+2 ms)Closed at 1676264190987 (+1 ms) 2023-02-13 04:56:30,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676264159173.5da706e80ec7bbb4fd54525c6463321f. 2023-02-13 04:56:30,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 761c0e5bb8f03a25298dfc51c2ad6940, disabling compactions & flushes 2023-02-13 04:56:30,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:56:30,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:56:30,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. after waiting 0 ms 2023-02-13 04:56:30,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:56:30,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/ns/testMinorCompaction/761c0e5bb8f03a25298dfc51c2ad6940/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 04:56:30,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:56:30,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 761c0e5bb8f03a25298dfc51c2ad6940: Waiting for close lock at 1676264190987Running coprocessor pre-close hooks at 1676264190987Disabling compacts and flushes for region at 1676264190987Disabling writes for close at 1676264190987Writing region close event to WAL at 1676264190990 (+3 ms)Running coprocessor post-close hooks at 1676264190993 (+3 ms)Closed at 1676264190993 2023-02-13 04:56:30,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676264140517.761c0e5bb8f03a25298dfc51c2ad6940. 2023-02-13 04:56:30,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 33ece068d353171a34dc973e93f1580e, disabling compactions & flushes 2023-02-13 04:56:30,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:56:30,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:56:30,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. after waiting 0 ms 2023-02-13 04:56:30,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:56:30,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 33ece068d353171a34dc973e93f1580e 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-13 04:56:30,995 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-13 04:56:31,150 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1505): Waiting on 1588230740, 22d440af5bfcfc9939787c5bb9ea8367, 2b73a7398b958006c5f263c04e379210, 33ece068d353171a34dc973e93f1580e, 4c9709d2533d414215f87f6eef92b74b, 63d8864f440c3c313b1eb8310d5cd3db, 6dbfce3ec623083abb6cac001ddc4fd8, 884e4256c9aa5930bdd891bcf997257a, 8937f228f64ed9a20627ea05b6572001, c2a39fa957db2c535903d705efd223f5, df6dd8289209e33a66ab42a45700acff, e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:56:31,351 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1505): Waiting on 1588230740, 22d440af5bfcfc9939787c5bb9ea8367, 2b73a7398b958006c5f263c04e379210, 33ece068d353171a34dc973e93f1580e, 4c9709d2533d414215f87f6eef92b74b, 63d8864f440c3c313b1eb8310d5cd3db, 6dbfce3ec623083abb6cac001ddc4fd8, 884e4256c9aa5930bdd891bcf997257a, 8937f228f64ed9a20627ea05b6572001, c2a39fa957db2c535903d705efd223f5, df6dd8289209e33a66ab42a45700acff, e994b917f8df7b3d815819b2163f57fb 2023-02-13 04:56:31,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/.tmp/info/3f483543b97b4a8d92b937c7eba47f07 2023-02-13 04:56:31,366 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f483543b97b4a8d92b937c7eba47f07 2023-02-13 04:56:31,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e/.tmp/info/b1cab7449214471292ba5b4a79f00a7b 2023-02-13 04:56:31,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e/.tmp/info/b1cab7449214471292ba5b4a79f00a7b as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e/info/b1cab7449214471292ba5b4a79f00a7b 2023-02-13 04:56:31,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e/info/b1cab7449214471292ba5b4a79f00a7b, entries=3, sequenceid=7, filesize=4.8 K 2023-02-13 04:56:31,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 33ece068d353171a34dc973e93f1580e in 418ms, sequenceid=7, compaction requested=false 2023-02-13 04:56:31,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/namespace/33ece068d353171a34dc973e93f1580e/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-13 04:56:31,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 33ece068d353171a34dc973e93f1580e: Waiting for close lock at 1676264190993Running coprocessor pre-close hooks at 1676264190993Disabling compacts and flushes for region at 1676264190993Disabling writes for close at 1676264190993Obtaining lock to block concurrent updates at 1676264190994 (+1 ms)Preparing flush snapshotting stores in 33ece068d353171a34dc973e93f1580e at 1676264190994Finished memstore snapshotting hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676264190994Flushing stores of hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. at 1676264190994Flushing 33ece068d353171a34dc973e93f1580e/info: creating writer at 1676264190994Flushing 33ece068d353171a34dc973e93f1580e/info: appending metadata at 1676264190996 (+2 ms)Flushing 33ece068d353171a34dc973e93f1580e/info: closing flushed file at 1676264190996Flushing 33ece068d353171a34dc973e93f1580e/info: reopening flushed file at 1676264191407 (+411 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 33ece068d353171a34dc973e93f1580e in 418ms, sequenceid=7, compaction requested=false at 1676264191411 (+4 ms)Writing region close event to WAL at 1676264191412 (+1 ms)Running coprocessor post-close hooks at 1676264191415 (+3 ms)Closed at 1676264191415 2023-02-13 04:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676264022767.33ece068d353171a34dc973e93f1580e. 2023-02-13 04:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c2a39fa957db2c535903d705efd223f5, disabling compactions & flushes 2023-02-13 04:56:31,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. after waiting 0 ms 2023-02-13 04:56:31,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:56:31,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/c2a39fa957db2c535903d705efd223f5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 04:56:31,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c2a39fa957db2c535903d705efd223f5: Waiting for close lock at 1676264191415Running coprocessor pre-close hooks at 1676264191415Disabling compacts and flushes for region at 1676264191415Disabling writes for close at 1676264191415Writing region close event to WAL at 1676264191416 (+1 ms)Running coprocessor post-close hooks at 1676264191418 (+2 ms)Closed at 1676264191419 (+1 ms) 2023-02-13 04:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676264059487.c2a39fa957db2c535903d705efd223f5. 2023-02-13 04:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4c9709d2533d414215f87f6eef92b74b, disabling compactions & flushes 2023-02-13 04:56:31,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. after waiting 0 ms 2023-02-13 04:56:31,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:31,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/4c9709d2533d414215f87f6eef92b74b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 04:56:31,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4c9709d2533d414215f87f6eef92b74b: Waiting for close lock at 1676264191419Running coprocessor pre-close hooks at 1676264191419Disabling compacts and flushes for region at 1676264191419Disabling writes for close at 1676264191419Writing region close event to WAL at 1676264191420 (+1 ms)Running coprocessor post-close hooks at 1676264191422 (+2 ms)Closed at 1676264191422 2023-02-13 04:56:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676264171774.4c9709d2533d414215f87f6eef92b74b. 2023-02-13 04:56:31,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2b73a7398b958006c5f263c04e379210, disabling compactions & flushes 2023-02-13 04:56:31,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:56:31,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:56:31,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. after waiting 0 ms 2023-02-13 04:56:31,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:56:31,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithMonthlyPolicy/2b73a7398b958006c5f263c04e379210/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 04:56:31,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:56:31,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2b73a7398b958006c5f263c04e379210: Waiting for close lock at 1676264191422Running coprocessor pre-close hooks at 1676264191422Disabling compacts and flushes for region at 1676264191422Disabling writes for close at 1676264191423 (+1 ms)Writing region close event to WAL at 1676264191423Running coprocessor post-close hooks at 1676264191425 (+2 ms)Closed at 1676264191426 (+1 ms) 2023-02-13 04:56:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676264038007.2b73a7398b958006c5f263c04e379210. 2023-02-13 04:56:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6dbfce3ec623083abb6cac001ddc4fd8, disabling compactions & flushes 2023-02-13 04:56:31,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. after waiting 0 ms 2023-02-13 04:56:31,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:31,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/6dbfce3ec623083abb6cac001ddc4fd8/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 04:56:31,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:31,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6dbfce3ec623083abb6cac001ddc4fd8: Waiting for close lock at 1676264191427Running coprocessor pre-close hooks at 1676264191427Disabling compacts and flushes for region at 1676264191427Disabling writes for close at 1676264191427Writing region close event to WAL at 1676264191427Running coprocessor post-close hooks at 1676264191429 (+2 ms)Closed at 1676264191429 2023-02-13 04:56:31,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676264171774.6dbfce3ec623083abb6cac001ddc4fd8. 2023-02-13 04:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing df6dd8289209e33a66ab42a45700acff, disabling compactions & flushes 2023-02-13 04:56:31,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. after waiting 0 ms 2023-02-13 04:56:31,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:56:31,432 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 04:56:31,432 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 04:56:31,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/df6dd8289209e33a66ab42a45700acff/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 04:56:31,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:56:31,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for df6dd8289209e33a66ab42a45700acff: Waiting for close lock at 1676264191430Running coprocessor pre-close hooks at 1676264191430Disabling compacts and flushes for region at 1676264191430Disabling writes for close at 1676264191430Writing region close event to WAL at 1676264191430Running coprocessor post-close hooks at 1676264191432 (+2 ms)Closed at 1676264191432 2023-02-13 04:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676264091299.df6dd8289209e33a66ab42a45700acff. 2023-02-13 04:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e994b917f8df7b3d815819b2163f57fb, disabling compactions & flushes 2023-02-13 04:56:31,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. after waiting 0 ms 2023-02-13 04:56:31,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:56:31,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testScannerOnBulkLoadRefHFiles/e994b917f8df7b3d815819b2163f57fb/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 04:56:31,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:56:31,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e994b917f8df7b3d815819b2163f57fb: Waiting for close lock at 1676264191433Running coprocessor pre-close hooks at 1676264191433Disabling compacts and flushes for region at 1676264191433Disabling writes for close at 1676264191433Writing region close event to WAL at 1676264191433Running coprocessor post-close hooks at 1676264191435 (+2 ms)Closed at 1676264191435 2023-02-13 04:56:31,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676264059487.e994b917f8df7b3d815819b2163f57fb. 2023-02-13 04:56:31,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 63d8864f440c3c313b1eb8310d5cd3db, disabling compactions & flushes 2023-02-13 04:56:31,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:31,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:31,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. after waiting 0 ms 2023-02-13 04:56:31,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:31,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionFromAdmin/63d8864f440c3c313b1eb8310d5cd3db/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 04:56:31,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:31,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 63d8864f440c3c313b1eb8310d5cd3db: Waiting for close lock at 1676264191435Running coprocessor pre-close hooks at 1676264191435Disabling compacts and flushes for region at 1676264191435Disabling writes for close at 1676264191435Writing region close event to WAL at 1676264191436 (+1 ms)Running coprocessor post-close hooks at 1676264191439 (+3 ms)Closed at 1676264191439 2023-02-13 04:56:31,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676264171774.63d8864f440c3c313b1eb8310d5cd3db. 2023-02-13 04:56:31,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8937f228f64ed9a20627ea05b6572001, disabling compactions & flushes 2023-02-13 04:56:31,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:56:31,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:56:31,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. after waiting 0 ms 2023-02-13 04:56:31,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:56:31,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testCompactionWithHFileLink/8937f228f64ed9a20627ea05b6572001/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 04:56:31,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:56:31,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8937f228f64ed9a20627ea05b6572001: Waiting for close lock at 1676264191439Running coprocessor pre-close hooks at 1676264191439Disabling compacts and flushes for region at 1676264191439Disabling writes for close at 1676264191439Writing region close event to WAL at 1676264191440 (+1 ms)Running coprocessor post-close hooks at 1676264191442 (+2 ms)Closed at 1676264191442 2023-02-13 04:56:31,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676264112021.8937f228f64ed9a20627ea05b6572001. 2023-02-13 04:56:31,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 884e4256c9aa5930bdd891bcf997257a, disabling compactions & flushes 2023-02-13 04:56:31,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:56:31,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:56:31,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. after waiting 0 ms 2023-02-13 04:56:31,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:56:31,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMinorCompactionWithWeeklyPolicy/884e4256c9aa5930bdd891bcf997257a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 04:56:31,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 884e4256c9aa5930bdd891bcf997257a: Waiting for close lock at 1676264191442Running coprocessor pre-close hooks at 1676264191442Disabling compacts and flushes for region at 1676264191442Disabling writes for close at 1676264191442Writing region close event to WAL at 1676264191443 (+1 ms)Running coprocessor post-close hooks at 1676264191445 (+2 ms)Closed at 1676264191445 2023-02-13 04:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676264047386.884e4256c9aa5930bdd891bcf997257a. 2023-02-13 04:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 22d440af5bfcfc9939787c5bb9ea8367, disabling compactions & flushes 2023-02-13 04:56:31,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. after waiting 0 ms 2023-02-13 04:56:31,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:56:31,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/default/testMajorCompactionWithWeeklyPolicy/22d440af5bfcfc9939787c5bb9ea8367/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-02-13 04:56:31,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:56:31,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 22d440af5bfcfc9939787c5bb9ea8367: Waiting for close lock at 1676264191446Running coprocessor pre-close hooks at 1676264191446Disabling compacts and flushes for region at 1676264191446Disabling writes for close at 1676264191446Writing region close event to WAL at 1676264191446Running coprocessor post-close hooks at 1676264191449 (+3 ms)Closed at 1676264191449 2023-02-13 04:56:31,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676264064470.22d440af5bfcfc9939787c5bb9ea8367. 2023-02-13 04:56:31,551 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 04:56:31,751 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 04:56:31,772 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/.tmp/rep_barrier/6d370771f94f441890099378996c703e 2023-02-13 04:56:31,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d370771f94f441890099378996c703e 2023-02-13 04:56:31,951 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 04:56:31,952 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 04:56:31,952 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 04:56:32,152 DEBUG [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 04:56:32,182 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/.tmp/table/bf130c775a6e4580ac29faa6009fe34f 2023-02-13 04:56:32,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf130c775a6e4580ac29faa6009fe34f 2023-02-13 04:56:32,187 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/.tmp/info/3f483543b97b4a8d92b937c7eba47f07 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/info/3f483543b97b4a8d92b937c7eba47f07 2023-02-13 04:56:32,190 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f483543b97b4a8d92b937c7eba47f07 2023-02-13 04:56:32,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/info/3f483543b97b4a8d92b937c7eba47f07, entries=226, sequenceid=130, filesize=37.9 K 2023-02-13 04:56:32,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/.tmp/rep_barrier/6d370771f94f441890099378996c703e as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/rep_barrier/6d370771f94f441890099378996c703e 2023-02-13 04:56:32,194 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d370771f94f441890099378996c703e 2023-02-13 04:56:32,194 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/rep_barrier/6d370771f94f441890099378996c703e, entries=1, sequenceid=130, filesize=5.0 K 2023-02-13 04:56:32,194 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/.tmp/table/bf130c775a6e4580ac29faa6009fe34f as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/table/bf130c775a6e4580ac29faa6009fe34f 2023-02-13 04:56:32,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf130c775a6e4580ac29faa6009fe34f 2023-02-13 04:56:32,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/table/bf130c775a6e4580ac29faa6009fe34f, entries=27, sequenceid=130, filesize=6.6 K 2023-02-13 04:56:32,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1249ms, sequenceid=130, compaction requested=false 2023-02-13 04:56:32,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-13 04:56:32,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:56:32,203 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:56:32,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676264190950Running coprocessor pre-close hooks at 1676264190950Disabling compacts and flushes for region at 1676264190950Disabling writes for close at 1676264190950Obtaining lock to block concurrent updates at 1676264190950Preparing flush snapshotting stores in 1588230740 at 1676264190950Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51772, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676264190950Flushing stores of hbase:meta,,1.1588230740 at 1676264190950Flushing 1588230740/info: creating writer at 1676264190951 (+1 ms)Flushing 1588230740/info: appending metadata at 1676264190954 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676264190954Flushing 1588230740/rep_barrier: creating writer at 1676264191366 (+412 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676264191368 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676264191368Flushing 1588230740/table: creating writer at 1676264191776 (+408 ms)Flushing 1588230740/table: appending metadata at 1676264191778 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676264191778Flushing 1588230740/info: reopening flushed file at 1676264192187 (+409 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676264192191 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676264192195 (+4 ms)Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1249ms, sequenceid=130, compaction requested=false at 1676264192199 (+4 ms)Writing region close event to WAL at 1676264192201 (+2 ms)Running coprocessor post-close hooks at 1676264192203 (+2 ms)Closed at 1676264192203 2023-02-13 04:56:32,203 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 04:56:32,219 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 04:56:32,352 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37513,1676264019660; all regions closed. 2023-02-13 04:56:32,359 DEBUG [RS:0;jenkins-hbase4:37513] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/oldWALs 2023-02-13 04:56:32,359 INFO [RS:0;jenkins-hbase4:37513] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37513%2C1676264019660.meta:.meta(num 1676264022510) 2023-02-13 04:56:32,362 DEBUG [RS:0;jenkins-hbase4:37513] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/oldWALs 2023-02-13 04:56:32,362 INFO [RS:0;jenkins-hbase4:37513] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37513%2C1676264019660:(num 1676264021600) 2023-02-13 04:56:32,362 DEBUG [RS:0;jenkins-hbase4:37513] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:56:32,362 INFO [RS:0;jenkins-hbase4:37513] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:56:32,363 INFO [RS:0;jenkins-hbase4:37513] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 04:56:32,363 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:56:32,364 INFO [RS:0;jenkins-hbase4:37513] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37513 2023-02-13 04:56:32,372 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37513,1676264019660 2023-02-13 04:56:32,372 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:56:32,372 ERROR [Listener at localhost/37751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b165367 rejected from java.util.concurrent.ThreadPoolExecutor@6f29cadd[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:56:32,373 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:56:32,373 ERROR [Listener at localhost/37751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@421f597d rejected from java.util.concurrent.ThreadPoolExecutor@6f29cadd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:56:32,375 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37513,1676264019660] 2023-02-13 04:56:32,375 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37513,1676264019660; numProcessing=1 2023-02-13 04:56:32,377 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37513,1676264019660 already deleted, retry=false 2023-02-13 04:56:32,377 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37513,1676264019660 expired; onlineServers=0 2023-02-13 04:56:32,377 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36431,1676264018484' ***** 2023-02-13 04:56:32,377 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 04:56:32,377 DEBUG [M:0;jenkins-hbase4:36431] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@351c8ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:56:32,378 INFO [M:0;jenkins-hbase4:36431] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36431,1676264018484 2023-02-13 04:56:32,378 INFO [M:0;jenkins-hbase4:36431] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36431,1676264018484; all regions closed. 2023-02-13 04:56:32,378 DEBUG [M:0;jenkins-hbase4:36431] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:56:32,378 DEBUG [M:0;jenkins-hbase4:36431] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 04:56:32,378 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 04:56:32,378 DEBUG [M:0;jenkins-hbase4:36431] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 04:56:32,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676264021240] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676264021240,5,FailOnTimeoutGroup] 2023-02-13 04:56:32,378 INFO [M:0;jenkins-hbase4:36431] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 04:56:32,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676264021238] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676264021238,5,FailOnTimeoutGroup] 2023-02-13 04:56:32,378 INFO [M:0;jenkins-hbase4:36431] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 04:56:32,378 INFO [M:0;jenkins-hbase4:36431] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 04:56:32,379 DEBUG [M:0;jenkins-hbase4:36431] master.HMaster(1502): Stopping service threads 2023-02-13 04:56:32,379 INFO [M:0;jenkins-hbase4:36431] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 04:56:32,379 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 04:56:32,379 ERROR [M:0;jenkins-hbase4:36431] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 04:56:32,379 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-13 04:56:32,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:56:32,380 INFO [M:0;jenkins-hbase4:36431] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 04:56:32,380 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 04:56:32,380 DEBUG [M:0;jenkins-hbase4:36431] zookeeper.ZKUtil(398): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 04:56:32,380 WARN [M:0;jenkins-hbase4:36431] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 04:56:32,380 INFO [M:0;jenkins-hbase4:36431] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 04:56:32,380 INFO [M:0;jenkins-hbase4:36431] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 04:56:32,380 DEBUG [M:0;jenkins-hbase4:36431] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:56:32,381 INFO [M:0;jenkins-hbase4:36431] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:56:32,381 DEBUG [M:0;jenkins-hbase4:36431] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:56:32,381 DEBUG [M:0;jenkins-hbase4:36431] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:56:32,381 DEBUG [M:0;jenkins-hbase4:36431] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:56:32,381 INFO [M:0;jenkins-hbase4:36431] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.53 KB heapSize=598.38 KB 2023-02-13 04:56:32,475 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:56:32,475 INFO [RS:0;jenkins-hbase4:37513] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37513,1676264019660; zookeeper connection closed. 2023-02-13 04:56:32,475 ERROR [Listener at localhost/37751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3a15e9b4 rejected from java.util.concurrent.ThreadPoolExecutor@6f29cadd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:56:32,475 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): regionserver:37513-0x1004c06f8aa0001, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:56:32,476 ERROR [Listener at localhost/37751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7268ca9f rejected from java.util.concurrent.ThreadPoolExecutor@6f29cadd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:56:32,476 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7772576a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7772576a 2023-02-13 04:56:32,476 INFO [Listener at localhost/37751] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-13 04:56:32,789 INFO [M:0;jenkins-hbase4:36431] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.53 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ab313ab6459c4be982dea984db8e3ae9 2023-02-13 04:56:32,792 INFO [M:0;jenkins-hbase4:36431] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab313ab6459c4be982dea984db8e3ae9 2023-02-13 04:56:32,793 DEBUG [M:0;jenkins-hbase4:36431] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ab313ab6459c4be982dea984db8e3ae9 as hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ab313ab6459c4be982dea984db8e3ae9 2023-02-13 04:56:32,796 INFO [M:0;jenkins-hbase4:36431] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab313ab6459c4be982dea984db8e3ae9 2023-02-13 04:56:32,796 INFO [M:0;jenkins-hbase4:36431] regionserver.HStore(1080): Added hdfs://localhost:42827/user/jenkins/test-data/cf864af4-73eb-a33b-3939-6a44ec2fd553/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ab313ab6459c4be982dea984db8e3ae9, entries=123, sequenceid=1006, filesize=33.3 K 2023-02-13 04:56:32,797 INFO [M:0;jenkins-hbase4:36431] regionserver.HRegion(2947): Finished flush of dataSize ~512.53 KB/524827, heapSize ~598.36 KB/612720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1006, compaction requested=false 2023-02-13 04:56:32,797 INFO [M:0;jenkins-hbase4:36431] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:56:32,798 DEBUG [M:0;jenkins-hbase4:36431] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676264192380Disabling compacts and flushes for region at 1676264192380Disabling writes for close at 1676264192381 (+1 ms)Obtaining lock to block concurrent updates at 1676264192381Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676264192381Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=524827, getHeapSize=612720, getOffHeapSize=0, getCellsCount=1161 at 1676264192381Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676264192381Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676264192381Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676264192385 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676264192385Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676264192793 (+408 ms)Finished flush of dataSize ~512.53 KB/524827, heapSize ~598.36 KB/612720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1006, compaction requested=false at 1676264192797 (+4 ms)Writing region close event to WAL at 1676264192797Closed at 1676264192797 2023-02-13 04:56:32,800 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:56:32,800 INFO [M:0;jenkins-hbase4:36431] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 04:56:32,801 INFO [M:0;jenkins-hbase4:36431] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36431 2023-02-13 04:56:32,803 DEBUG [M:0;jenkins-hbase4:36431] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36431,1676264018484 already deleted, retry=false 2023-02-13 04:56:32,910 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:56:32,911 INFO [M:0;jenkins-hbase4:36431] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36431,1676264018484; zookeeper connection closed. 2023-02-13 04:56:32,911 ERROR [Listener at localhost/37751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c176a1c rejected from java.util.concurrent.ThreadPoolExecutor@62e241f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:56:32,911 DEBUG [Listener at localhost/37751-EventThread] zookeeper.ZKWatcher(600): master:36431-0x1004c06f8aa0000, quorum=127.0.0.1:54862, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:56:32,911 ERROR [Listener at localhost/37751-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e7b3889 rejected from java.util.concurrent.ThreadPoolExecutor@62e241f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:56:32,913 WARN [Listener at localhost/37751] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:56:32,916 INFO [Listener at localhost/37751] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:56:33,022 WARN [BP-920358726-172.31.14.131-1676264015206 heartbeating to localhost/127.0.0.1:42827] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:56:33,022 WARN [BP-920358726-172.31.14.131-1676264015206 heartbeating to localhost/127.0.0.1:42827] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-920358726-172.31.14.131-1676264015206 (Datanode Uuid d8b42276-0f0c-4620-8eae-4cb8d42ffb66) service to localhost/127.0.0.1:42827 2023-02-13 04:56:33,024 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/cluster_98a6d5ea-75e8-c972-88d1-3a74142f0e58/dfs/data/data1/current/BP-920358726-172.31.14.131-1676264015206] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:56:33,025 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3d696185-3745-f0cb-9ed6-65e7f2b5c533/cluster_98a6d5ea-75e8-c972-88d1-3a74142f0e58/dfs/data/data2/current/BP-920358726-172.31.14.131-1676264015206] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:56:33,051 INFO [Listener at localhost/37751] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:56:33,186 INFO [Listener at localhost/37751] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 04:56:33,299 INFO [Listener at localhost/37751] hbase.HBaseTestingUtility(1293): Minicluster is down